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OVERVIiW 



Performance contracting in schools— dcspi te its premature obltuarv 
written in 1972 by the Office of Economic Opportunity (OEO)— is not delid. 
In fact, It is still very much alive as one of today's hotter education 
controversies. 

Despite nogntive results from 18 OEO eKperliiientn 1 projects, at loaHt 
100 perforiiiance contracts were in effect in the middle of 1972.' 

Thus, it is clear the idea is still being tested. Many educfitora beliovo 
the concept has great potential to improve education and to achieve quick 
change. As a result, they are still wiUins to cry it in its numerous form^ 
despice the fact that it has become so controversial. 

Since its Inception in 1969, thousands of words describing performance 
contracting have appeared in the mass media and in the education presES But 
most educators still don't have an accurate picture of what has happianed in 
the opinion of authorities on performance contracting. The reason: an amaz- 
ing amount of confused, biased, simplistic news reporting. 

Some of the most unbalanced and unquestioning reporting occurred when 
GEO released the results of its experimental efforts at a Washington DC 
press conference in February 1972. Most of the accounts that followed accepted 
QhQ s totally pessimistic conclusions about performance contracting without 
question. Several months later, however. Journalists began to have second 
thoughts The New York Times, for example, is now questioning OEO's conclu- 
sions. The flat assertion by the OEO that performance contracting has failed 
as d means of improving learning in 
the public schools," the Times wrote 
in an editorial, "is an oddly "quick 
and sweeping judgment after only one 
year's experimentation." 

The Times continued: "Some 
aspects of the contracting con- 
cept have always been subject to 
legitimate cautions. In the hands 
of unscrupulous operators, chil- 
dren could be pushed toward lim- 
ited, rote-learning achievements, 
without concern for their overiill 
development and psychological wel- 
fare. The possibility of outright 
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cheating j by manipulating either the pupils or tlie te^ts, is always a matter 
of concern when potential profits or losses are at stake* 

"Despite thesti dangers and precisely because of the compleKity of the 
approach^ the sweepingly negativa evaluation by OEO has the e^^rmarks of a 
subjective 5 if tiot downright political, judgment rather than a scientific 
assessment. At so early a stage of the eKperimentj it would t ave been far 
more useful to weed out those contractors whose methods seamefi either inef^ 
fective or suspected." The Times editorial noted other difficulties facing 
performance contracting in education, "It is no secret^" it said, "that tlie 
organized teaching profession has been lobbying hard to discredit performance 
contracting^ at least in part because of fear that budget-cutting forces saw 
the proJects^-miEguldedly J we believe----^primarily as a way to reduce the 
instructional payroll," 

In addition to the OEO study ^ another group of performance contract proj^ 
ects were evaluated by the Rand Corp. in 1972, Its conclusion* the per for- 
mance contracts had fulfilled only half the claims made for them^ — they had 
proved to be "an instrument of change, stiniulatlng innnvations j " but they had 
not "solved America *s compensatory education problem," The projects failed 
to achieve better reaults on achievement tests than standard classroom in-- 
structlon^ Rand said* 

Thus^ the debate continues over a simple concept which has revolutionary 
implications. In a nutshell ^ the idea is this ^ schools contract with a 
private firm for aervlces and the pay depends on the results^^better pay for 
better work. The approach is seen as a vehicle for bringing accountability 
to the public schools . 

The original promoters of the idea in education were U.S. Office of Edu- 
cation (USOE) officials j private firms in the education business and a few 
educators. They thought it might provide a quick breakthrough in compensafiory 
education. The first actual working project was launched in Texarkanaj a 
city partially in Texas and partially in Arkansas* Two of the three school 
districts in the areas both using federal money, hired a private corporation 
to teach reading and mathematics skills to potential dropouts. They agreed 
on a performance contract: the better the tested results of students- learn- 
ing ^ the more the company would earn. 

The story of this first experiment made headlines in 1970 when the first 
rosy reports of substantial successes were dashed with charges that students 
had been given a preview of test questions before they took the final exams. 
The entire concept was threatened with extinction by this one incident* The 
sensational exposa failed to derail the TeKarkana project, which eventually 
produced substantial successes in reducing the student dropout rate, 

A result of the early performance contracting efforts has been a re-^ 
kindling of professional concern over educators' use and misuse of testing. 
Many of the nation - s testing authorities claitn that performance contracts 
illustrate flagrant misuse and widespread misunderstanding of standardized 
tests as evaluation tools. They explain that conclusions based on these 
test scores may be erroneous. Nevertheless, almost all reported results 
of performance contracts have emphasized test scores, 
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Meanwhile, with far lass publicity, other kinds of ediicational projects 
also began with performance contracts r projects to teach vocational skills, 
to raise achievement motivation ^ to train teachers, to create an altarncitlvc 
high school and to teach an entire elementary school curriculum. Michignn*s 
involvement includes a conmitment of $23 million in compensatory education 
funds to "performance pacts" between the State Dept. of Education and the 69 
districts participating In the program. Elsewhere, some distrlctg have signed 
performance contracts with groups of teachers. 

Supporters of performance contracting claim it encourages efficiency , 
aerves as an incentive to good work and promotes rapid change. Others say 
it is wasteful of money and energy, promotes harmful competition and reinforces 
the most trivial education objectives* Some see the businesslike character of 
the contracts as a virtue; others find the business profit motive repugnant 
in education. Rhetoric over this issue has rarely been restrained* 

The purpose of this Special Report Is to cut through the rhetoric of 
both sides and bring the issues into meaningful focus. 
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WHAT IS A PERFORMANCE CONTRACT? 

The idea of a "perf onnance contract" is not a new one ^ even though it 
is new within education. A perfarmanca contract is any contract in which 
the contractor's payment is linked to the measurable quality of his perfor- 
mance. For example, an entertainer may be paid a percentage of the boK 
office receipts—the more people he brings in, the more he is paid. A manu-- 
facturing firm may receive a boiiiis if delivery is ahead of schedule, but pay 
a penalty If delivery is late. Performance contracts are a specific variety 
of contract, rather common in business. Charles Blaschke , president of Edu- 
cation Turnkey Systems , Inc., helped design the Texarkana project in 1969. 
He had learned of performance contracts while serving his military duty in the 
Defense Dept,, where such contracts are sometimes used. 

The Rand Corp*, in the first volmne of a lengthy report it has prepared 
for the Dept. of Health, Education and Welfare (HEW), entitled The Performance 
Concept in Education ^ explains four basic kinds of contracts . To help in 
their explanations , authors J, Stucker and R, Hall use the purchase 
of busing as an SKample : 

• . F ijc ed c on t r ac t s f o r _r es mxr ce^ i a service or product is supplied, for 

an agreed-upon price. For examples a school district contracts for a 
fleet of buses and drivers. The bus company receives a fixed fees say 
$100,000. 

• Perf orTnance contracts for resources : a service or product is supplied 
on demand, as needed* The price will vary with demand* For example^ a 
school district agrees to purchase busing for any after-school activity 

at $40 per bus per hour* Only when the contractor "performs'- by supplying 
buses, does he get paid* 

• Flxed^ contracts for results * a service or product is supplied at an 
agreed upon price, and at an agreed upon standard of quality* For ex- 
atnple, a school district pays 50$ per child per day for on^-time delivery 
of students. If students are latei the company receives no pay. 

© PerformancB contracts for results ; a service or product is supplied 
with a price that varies according to the quality* For example, a 
school district pays for on-time delivery of children at 40$, five minutes 
late at 30$, ten minutes late at 20(?. 

Stucker and Hall-s example'=-*how schools might buy busing- — may seem dry 
as dust* At first glance, the differences may seem like quibbling* However, 
in Texarkana, two school districts signed a contract for measurable gair in 



children's learning. And they decided, among the f^our contracting approaches, 
to pay the contractor very little if the youngsters laarncd verv lULle, move' 
afa .Am children learned more. Whtm this happened, the diffarencGs in contrncCH 
no longer seemed like quibbling. 

The question raised by the Texarkana project and others is "How should 
schools purchase education?" A return to the four kinds of contracts displavs 
the options : ■ . 

• Fixed cont ract s for re sources; This is the ordinary way schools purchase 
education. Schools contract with teachers to teach, at 'a tixed rate of 
so much per year. 

• Performance contracts for resources - This is the wav schools ordlnnrlly 
purchase the services of substitute teachers. Schools agree to pay so 
much per teaching day when they require such services. 

• J^ixed eontracts for results; This kind f contract is almost unhcnrd 
of in education, A hypothetical example would be to pay teachers $300 
per student if and only if the student passed an end-of-year tetat. 

• Performance contractB for reaul ta : This kind of contract is also rare 

A hypothtatlcal example would be to pay teachers $300 for each student who 
received 100% on an end-of-year test, $275 for each student at 90%, $250 
for each student at 801, and so on. 

^^When the options are displayed, suddenly there is controversy: What are 
the results" of education? Can results be measured? Is it right to pay 
for results instead of for resnurces? Should schools imitate business? 
What are educational results worth? 

Private companies such as Dorsett Educational Systems have agreed to 
teach students on the basis of "performance contracts for resultssJ* With very 
few exceptions, teachers have been reluctant to risk their income in such 
contracts. This raises nore questions? mat motivates these private companies 
who step where most teachers fear to tread? Should teachers imitate these 
companies, or should teachers denounce and fight the companies? Do these pro- 
jects "dehumanize" education? Are these contracts legal? 



A Gordian Knot of Terminology 

Most discussion of performance contracts gets embroiled not only in 
issues, but in language. People who talk about performance contracts use the 
term to mean niany different things: not only are the documents themselves 
referred to as "performance contracts" but the term usually means the proj- 
ects that result from the contracts. 

Companies which sign performance contracts and direct the projects are 
referred to as "performance contract companies." Also, the term is used to 
refer to the techniques employed in writing the contracts and to the tech- 
niques used in teaching the children. Since some of these companies have 
used unorthodox teaching procedures, these procedures— such as use of teaching 
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aides, emphasis on prograimTied instruction, paying incGnti^'i^s to studantB or 
to teachers"Of ten get labeled "perf ormance contracting J' 



Then 5 some scholars and somu government spokesmen talk about perforTiianco 
contracting as an Idaa, or a policy, or an attitude, or a concept* Somo 
journalists speak of the performance contract phenomenon. Some critics spoak 
of the performance contract plot or conspiracy. 

Not only does the simple meaning of the word change, but the feelings 
tone of the word varies in use. As the literature about performance contracts 
grovs J the term acq' Lres testimony, analysis ^ criticism , rapture^ disguBt, 
prescirip tlons 5 exhortations and reporting* 

Not only is the one term overburdened ^ but it has been linked to others t 
accountability, individualized instruction^ cost ef f ectiveness ^ Gystems ap^ 
proachj learnings dehumaniKation , educational-industrial compleK, And it 
has acquired its own special vocabulary: RFP j turnkey^ needs assessment, ed- 
ucational accomplishment audit* 

Even beyond this j becaitde performance contracts have Inspired so much 
controversy, the term "performance contract" is often bandied about as a 
symbol. Many teachers, especially those who belong to the American Federation 
of Teachers (AFT), vehemently criticize performance contracts; sometimes this 
criticism focuses on the terms of a contraQt, weaknesses in a project or specify 
ic practices such as giving trinkets to children for good work. But at other 
times 5 teachers are criticizing an attitude which they label "performance con- 
tracting*" In this light 5 "performance contracting" becomes symbolic of cost-- 
cutting j merit pay, anti^teacher biases ^ slick public relations ^ excessive 
profit taking and other vices. The AFT's accusations that^ performance con^ 
tracts represent "hucksters in the schools" are mostly symbolic accUBations ♦ 
Similarly s advocates of many new practices^=-inBtructional systems^ learning 
packages j behavior modification in the classroom., alternatives to teacher 
craining or to teacher certification ^ federal influenca on education, behav^ 
ioral objectives J measyrement and evaluation and many more—invoke performance 
contracts, symbolically, to illustrate and prove their point, 

To simmiarize* a new kind of contract has come Into use in education] 
it has been used primarily to hire private corporations to employ new ins true* 
tlonal practices I it calls for payment based on results. Controversy has 
resulted over many issues and because of that controversy * there has resulted 
a Gordian knot of language confusion. 

The Impact of Performance Contracts 

Frequently 5 performance contracts result In public debates over educa^ 
tlonal issues. Education Turnkey's Blaschke helped plan and manage many 
performance contracts In addition to designing the Texarkana contract* He 
calls performance contracts "catalysts for educational reform* " 

Sometimes performance contracts cause an uproar over their specific pro^ 
vislons-^^how much the company will be paidj what testing will measure the 
results 5 which otudents will participate^ — and sometimes they cause an uproar 
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over teaching methods. Ihere have also been fights over honesty or Integrity 
of both contractors and schoo] systems. There have been wrestling matchas for 
political control of schools. 

And often, contracts have been the catalyst for discuaaion of fundamental 
educational issues: Who should teach? (Paraprof essionals? ^'achines? Leain- 
xng companies?) mat should school be for? (To cram the 3 R's? To "civi- 
lize" or "humanize" or "propagandize" children?) Who should control schools? 
(Educators? Students? The state? Parents? School boards? The press?) 




Polls Shuw Public Support 

Perfonnance contracts emphasize results. in doing so, they sink tap- 
roots into beloved American concepts.* 

• "You gat 'What you pay for," 

• "Education is big business and should be run like big business," 

• "The know-how of private industry can solve any problem," 

• "Money talks." 

Among people wiio hold these values, and there are many, performance 
contracts have a deep appeal, as a 1971 Gallup Poll indicates. People were 
asked this question: 

In some public schools, educational companies are given contracts 
to put in new methods to teach the children in elementary schools 
certain basic skills, such as how to read. These are called "per- 
formance contracts." If the children don't reach a certain level 
of achievement, the company doesn't get paid for those children who 
fall to reach the standard. Would you like to have such contracts 
made here, in this conmunity, if the overall school costs remain 
about the same? 

According^ to the results reported in the September 1971 issue of Fhi 
Delta Kappan. 49% favored the idea, another 23% were undecided. The same poll 
in September 1970 showed that 23% favored it. The National School Boards Assn 
(NSBA) polled those who attended its 1971 national convention and reported in 
the July 1971 American Sc hool Board Journal that 521 of board members favored 
the idea; 31% ware undecided or indifferent. 

^ Performance contracts have raised several trends to public awareness, 
both within the education community and beyond. The emphasis on results has 
bolstered the advocates of behavioral objectives. The emphasis on costs as 
well as results has focused some attention on the importance of efficient 
management of schooling. The intrusion of private corporations into the 
limelight of educational Innovation has given succor to those who dislike the 
uniformity and monopolistic character of public schools. 

The use, In some contracts, of air-conditioned and carpeted environments 
and of techniques of motivating children such as rewards, tokens, time to play 
ate, has revived interest in "controlled environments," "contingency con- 
tracting and behavioral modification" as aducational procedures. 
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A Stepping Stone to Accountability 



As we shall see in the next chapter ^ performance contracts provided the 
stepping stone for the concept of ■'accountability . While that term has many 
meanings and ernphases , it has acquired a status akin to motherhood* According 
to the NSBA poll, 92% of school board members favor accountability. So do 
Pres. Nixon J the AFT, the National Education Assni (NEA) and some textbook 
publishers 5 though each uses the term to mean a different thing. 

Leon Lesslngerj former associate commissioner of the U.S, Office of Ed- 
ucation, has tried particularly hard to push accountability bmyond the status 
of mere slogan and has suggested a repertoire of procedures to achieve edu'- 
cational accountability. He and other advocates of accouutability cite per^ 
formance contracts as examples of these procedures—which they sometimes are 2 
performance planning and budgeting systems^ cost/benefit analysis^ mnagement 
by objectives, management information systems ^ needs assessment 5 formative 
and summative evaluation, educational accomplishment audits and more. 

In short, performance contracts have captured the imagination of many 
people. Where they have been used, they have sometimes sparked profitable 
public debate of educationrtl issues. Sometimes they have led to changes in 
school systems* In addition, they have influenced the national discussion 
of many aspects of education. And because of all this, some youngsters may 
learn better. 
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THE TEXARKANA EXPERIENCE 
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Performance contracting began in Texarkana by coincidence, 

Charles Blaschke, who proposed the concept to TeKarkana school adminis-^ 
trators, had explored the use of this technique for seme years. Ha discussed 
the subject Jn his 1965 thesis at Harvard u/on ''Federal Procurement Policies i 
A Means To Foster Innovation," Later, when he was at the U.S. Dept of Defense 
(DOD) , he was privy to speculation about use of DOD technology and management: 
techniques in other fields, including education. 

His 1967 attempt- to apply performance contracting within a Gainesville, 
Ga.j concentrated employmant program had been rebuffed. Its implications 
frightened away federal and state officials. He continued to search for a 
more receptive .situation. 

In 1968, Texarkana echools had a variety of problems i a high dropout 
rate (15% annually in poverty areas), pressure from HEW to desegregate, 
pressure from ^ite parents ^o feared that desegregation would lower the 
quality of schools, vast achievement differences between black and white 
secondary school students and an austerity budget. Because Texarkana city 
Sovernment had secured federal Model Cities demous tration funds in 1968, 
model cities officials wanted iticreased participation in education decisions. 

Recognising an opportune situation, a mutual friend suggested Blaschke 
speak to Tom McRae, director of the Model Cities program in Texarkana * McRae 
was impressed and arranged for Blaschke to meet Taxarkana's three school 
superintendents in December 1968, Blaschke persuaded them to apply for a 
planning grant to create a multlf aceted j five-year dropout prevention program. 
During the first year, in order to prevent low^achieving students from drop^ 
ping out of school, Texarkana would contract with a private educational com- 
pany to teach reading and mathematics skills. 

Blaschke became consultant to the three districts and within a week 
had submitted a proposal under the new Title VIII dropout prevention provi- 
sion of the Elementary and Secondary Education Act. Sen. George Murphy ^ 
R-Cali£,, had sponsored a measure in 1968 allowing districts to submit pro- 
posals outlining a specific educational problem they wished to solve. 

The district would receive a small planning grant to hire a "management 
suRport group'' to aid in writing a formal proposal. Monay for the program would 
be given to a small n™ber of districts for concentrated efforts. Moreover , 
an "independent educational accompUshmant auditor" would be hired who even- 
tually would certify the Vesults of the program. 
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Promoting Cost-Effioiarit School Programs 



From Blaschke-s point of view, performanet contracting is one managerial 
device for seeking and selecting cost-ef £ icient school programs. It allows 
a district to search the marketplace for the best available Ideas ^ then Gon= 
tract with the corporation submitting the best proposal. Eventually , the 
district can take over the contractor's teaching system— a process Blaschke 
calls ^'Lurnkey*" 

Texarkanas with its low achievement, high dropout rate, desegregation 
deadline and tight budget, provided an opportunity to demonstrate that schools 
could purchase low-cost, low-risk attempts to solve their problems. 

From school superintendents' point of vleW| Blaschke 's proposal would 
ease a crisis ^ provide extra money and jobsj lower the dropout ratej enhance 
their reputation and bring new techniques and expertise to the schools. Also, 
Blaschke adds^ a successful program would enable achool officials to demon^ 
strate chat certification, tenure and other regulations restrain school 
systems from solving th^lr own problems* It was a soinething'-for-everyone 
proposal which had wide public appeal in Texarkana, 

USOE's Leon Lessinger, formerly superintendent of the San Mateo, Calif, ^ 
Union High School Districts administered the Elementary and Secondary Edu= 
cation Act (ESEA) in 1968. He ^um conmitted to providing what Congress wanrc=*-di 
hard-^nQsed results. TeKarkan^ fitted this mold and was granted a planning 
grant under Title VIII, ESEA. 



The Lessinger-Blaschke Model 

Once the Texarkana project began in October 1969 Blaschke and Lessinger 
became spokesmen for performance contracting , Blaschke emphasized performance 
contracts' ability to reform schools, to use money more efficiently, to improve 
school management and to tap private industry as a source of new ideas* Less-^ 
Inger emphasized performance contracts as a way to specify school outcomes, 
demonstrate school ef f ectiveneas to the public^ and Improve accountability of 
federal projects* 

Thus, performance contracting emerged in 1969-70^ with TeKarkana its only 
example in educatloni It led to a new and strange vocabulary (to educators), 
high-powered federal government support and a new slogan, ■'accQuntabillty , " 

Performance contract , accountability s turnkey , RIP — all were evQlving 
concepts and practices. The terminology was Imprecise and shifting in meaning 
over time. It would be unfair to say that the following brief deSGriptlon 
Is a ■'fixed*' or final version of these ideas as Lessinger and Blaschke de- 
veloped them. 

But, esientially, behind the terminology, Blaschke and Lessinger concur 
that schools need sophisticated management technlquee. They hoped that per- 
forinance contracts, with their common sense appeal, would act as a foot in the 
^(5|""r for upgrading school management* 
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Blaschke and Lessinger spoke of ••needs assessment*' through which one 
systematically identifies what is needed in a school system and community and 
specifiei priorities, "Needs assessment'* defines a problem in need of solution, 
In TeKarkana, Blaschke consulted with coimnunlty agencies ^ public servants ^ po- 
liticians ^ community groups, students, teachers and others seeking a picture of 
what TeKarkana parceived were its needs and the '^actual" criteria to be used In 
judging an education program. 

After needs assessment , the school system or local education agency 
searches the marketplace for solutions. The school district writes a sat 
of specifications called RFP ("request for proposals") which it issues to 
all interested parties. At a "bidders conference," the district brings 
together potential bidders and dlscusies the problem to be solved, A "manage- 
ment support group" (MSG), which provides technical assistance and manpower 
to the local district, may conduct the needs assessment, assist in writing 
the proposal request and in calling the bidders conference. Blaschke ful= 
filled the management support role| he issued a proposal request to 113 edu^ 
cational technoldgy companiea and conductert a conference at which 40 companies 
wure represented. After such a conference, Interested partlea submit propos- 
als , In Texarkana, more than a doEen corporations expresBed interest, in- 
cluding RCA, McGraw-Hill, Macmillan and Behavioral Research Laboratories (BRL) . 

Once the proposals are received , the school district studies them and 
selects a contractor. The district then negotiates a perfomance contract , 
in which the contractor agrees to payment in accordance with the effective- 
ness of his teaching system. In addition to the contractor, and perhapi 
a management support groupp the district hires an "Independent outside eval- 
uator" to monitor the project and to administer, score and interpret evaluation 
instruments. It also hires an "educational accomplishment auditor'* to certify 
that the; evaluation is pi operly handled. At the concluaion of a project, a 
district may adopt^ — or as Blaschke says, "turnkey all or the best portions 
of a contractor's learning system. 



The First Year In Texarkana 

The contractor selected in TeKarkana was Dorsett Educational Systems, 
a manufacturer of teaching machines. The company promised to produce at 
least one yearns gain in reading and in mathematics for each student, as 
measured by standardized achievement tests * in 80 hours of Instruction, His 
fee was |80 pmt student per grade, with a sliding scale for more achievement 
per student than specified or for the amount of achievement specified, but in 
less time. If a student did not gain at least one year in reading or math, 
Dorsett would not be paid. 

The concept of "gain," as measured by standardized achievement teats easily 
persuaded the combined TeKarkana school boards to select Dorsett* It had 
promisGd the most '*cost-ef fectlve" program among the dozen biddera. That 
is, Dorsett "guaranteed" more learning (gain) for less cost. Not until months 
later did test experts begin to challenge this use ©f standardlEed tests to 
measure effectiveness. Rather, this usage was legitimized by its acceptance 
in Texarkana, and it became the evaluation model for most 1970-71 performance 
^ contracts. (See chapter on Testing, p,49*J 
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Dorsett hae proposed to establish sIk Rapid Learning Centers (RLCs) 
which each student attended two hours daily to study reading and mathematics 
skills* The first opensd Oct, IS, 1969 ^ and between then and May 1970^ over 
300 students enrolled in the RLCs* The typical RLC had one paraprof essional 
and one professional with 20 or so students at any one time. 

Dorse tt naade heavy use of its teaching machine to present instructional 
materials* This machine coordinates a film presentation with a sound record- 
ing* It responds by voice to students* correct and incorrect answers. How^ 
ever^ as this was Dorsett's first major demonstration of the machine^ the 
company had to either adapt other publishers' material or create teaching 
material in the course of the year. Thus, for Dorsett, the Texarkana project 
was an opportunity both to demonstrate the machine's capabilities and to 
davelop Instructional materials concurrent with instruction* 

In concept j Dorsett's Rapid Learning Centers were similar to their less 
publicized dropout programs elsewhere. They involved an attempt to "diagnose" 
student learning needs ^ "prescribe" what a student needed to laam and pre- 
sent him with a sequence of programmed instructional materials. The next 
yaar^ several other educational technology companies used this same basic 
"individualized instruction" concept. While the term "performance contract" 
refers primarily to the contracting process itself ^ publicity surrounding 
Texarkana and other performance contracts has tended to confuse "performance 
eontracting" with this individualiEed teaching strategy* In order to perfor-^ 
mance contract on the basis of student "gain," a pretest was given each child 
when he entered the learning center. When it was judged he had achieved 
sufficiently, he was retested. If he had gained at least one year's growth, 
he returned to his regular classroom and another student entered. 

Dorsett also attempted to use motivational techniques borrowed from work 
of behavioral psychologists and referred to as "contingency management." Es= 
sentiallyj this was a reward system in which students received small prices 
for lessons completed^ larger ones for tested achievement gains. In addition, 
good work and behavior entitled a student to free time to use games , puzzles, 
popular magazines; to listen to popular music | or to rap with friends. All 
of this was accompiished in a pleasant , carpeted, alr-cdnditioned environment 
which contrasted sharply with ordinary classrooms. During the school year, 
Dorsett 's use of Green Stamps and transistor radios as motivating devices 
received more publicity than any other aspect of the program. Other contracts 
have used similar techniques, some rather crudely, some with calculated preci- 
sion. 



How an RLC Operates 

Edward Trice, superintendent of Texarkana, Ark,, School District, de- 
scribes the operation of a Rapid Learning Center* 

The role of the teacher In the RLC is altogether different from 
the role of the teacher in the traditional classroom. She could 
be called an ins true tlonal mnager. She programs each Individual's 
aiiignmtnt. At the end of her school day she goes to the main cen- 
O ter and picks up her material for the next day— that is* the film 
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recofds and other software she needs* She takes this b^ick to the 
school and placei it in each child's folder. This arrangement allows 
the student to pick up where he left off the day before. 

When the child comes into the room he doesn^t take a seat and wait 
for a roll call or the tardy bell. He goes directly to his folder, 
picks up his material, gets his record and filmj goes to his machine 
and threads it himself. Then he puts his headset on and he's in 
business . 

The student couldn't care less about what others are doing; he 
can't even see or hear thenij for one thing. Then he starts his 
program* If he makes a mis take ^ there's no one to laugh at him. 

Most of the children have come out of a classroom with group in- 
struction where first of all they've been timid about reciting 
because they realize by now that they don't know the answers, 
They've been completely frustrated and humiliated. If they made 
a wrong answer, the whole class laughed at them* Children are 
just that way. And usually the teacher will not call on them 
because she* too, knows they can't answer. But here in the lab 
they're working on their own level ^ and If they make a mistake 
only the machine knows about iti 

There are incentives built into the process. We have found out 
that tangible incenttves have real value until the youngsters 
begin to achieve. After a whiles according to the project di*- 
rector .achievement is itself an incentive. Children enjoy 
actually achieving and they forget about the material incentives. 
But until they enjoy achievement, the incentives are built in. 

With slight variation in particulars, this description might describe 
a dozen or more other performance contract programs during 1970=71. 

Evaluators, Auditors Hired by District 

Texarkana hired the Arkansas Region VIII Education Service Center^ 
Magnolia, Ark*^ as evaluator for the project and EPIE Diversified Systems 
of Tucson, Ariz* J aa the auditor. In the first year of the contractj amid 
much confusion p Educational Testing Service was called in to help the Arkansas 
center with the evaluation, A team from Georgia Tech assisted the center in 
the second year. According to the Rand atudy of performance contracting, 
their work was among the best evaluation studies done of performance contracts. 
Their help proved particularly valuable In providing another viewpoint when 
scandal over testing broke out at uhe end of the project* 

The First Results: Promising Gains 

The first test results from the Texarkana project ware ravealad to the 
world In February 1970, They received national publicity. For examplei 
Q one publication reported s 
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Startling Reading Gains Hinted in Texarkana 



. The nation's first attempt at "guaranteed performance' —bringing 
into the schools an outside firm that promises to increase student 
? learning~s earns to be working* Preliminary spot tests of students 
who are baing taught by Dorse tt Educational Systems in the TeKar- 
kana USA Rapid Learning Center show achievement gains , after 48 
hours of Instruction, averaging more than two grade levels in 
reading and more than one grade level in math,.,. 

Since the Texarkana project first began in October^ more than 
250 sehool distficts have written to ask how they might do the 
same thing. And at least a dozen districts are in the initial 
stages of planning, says Leon Lessinger, the former associate 
conmilssioner of education who led the accountability movement 
last year * . * , 



Texarkana became what Richard Bumstead, editor of Educate , called "the 
meeca of the educatidnal world." " 

Needless to say^ educators were excited. Dorse tt^ Lesslnger, Blaschke, 
their representatives and their counterparts in other agencies, plus Texar- 
kana school officials^ spoke ^t national conferences, published in education^ 
al journals, contacted their friends and potential customers; momentum built. 

The greatest shove came from Pres. Nixon, whose March 3, 1970, educational 
policy address adopted the "accountability" standards 

Apart from the general public interest in providing teachers an 
honorable and well paid professional career , there Is only one 
important question to be added about educationi What do the chil= 
dren learn,*.* One conclusion is inescapable* We do not have equal 
educational opportunity in America.... 

The corresponding need in the school systems of the nation is to 
begin the responsible^ open measurement of how well the educa- 
tional process is working. It matters very little how much a 
school building costs | It matters a great deal how much a child 
in that building learns * * * * 

From these considerations we derive another new concept i account- 
ability. Sehool administrators and school teachers alike are 
responsible for their performance,,,. 

By summer, projects were announced for 1970-71 in Dallas, In seven 
Virginia counties, in California and in Michigan— and Education Turnkey Systems 
had connections with more than half of them. 

The biggest project was announced by CEO I a national experiment to 
determine whether performance contracting as used in Texarkana would serve 
13 lulflil Pres, Nixon »s demand for "accountabllitv J* 
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'Scandar Disclosed 

To the chagrin of OEO and others ^ the Dorsett project in Texarkana was 
greeted with scandal in July 1970* "Teaching to the test!*' was the accusa- 
tion. Prima facie evidence was discovered that some items in Dorsett teach-* 
Ing materials developed that year Gontained tast items from the final test 
used to determine payment to Dorsett, "Whatever the reason for that situation^"- 
Kenneth Gehret wrote a year later in Christian Science Monlto^r ^ "the lure of 
profits Is inevitably blamed," It was a severe black eye for performance con-' 
tracting; potential critics took this opportunity to condemn the entire 
concept and the federal government's interest in it. 

Exactly what occurred remains a matter of dispute and may never be re-- 
solved short of legal action. After the "teaching to the test" charge was 
publicised, claims and counterclaims were made by Dorsett, the Texarkana 
districts involvedj the internal evaluator j the auditors plus Educational 
Testing Service (ETS) ^ which was called in by USOE and the districts to 
counsel everyone. In brief, a junior high student taking a posttest in May 
remarked 5 within the hearing of Texarkana -s project director ^ that he was 
tired of answering the same old question. Apparently Dorsett chief pro-- 
gramme r and sister of Dorsett -s president had written materials containing 
the suspect test items which were included in student work during April and 
May. Dorsett claims that only 6.5% of the test items in the May test were 
affected and thatj while the company was appalled at the occurrence and eager 
to make any possible restitution, it felt the tests results were not greatly 
affected. Howeveri ETS concluded that the posttests. had been rendered invalid. 
The district withheld $30s000 because of the allegations* In April 1972 Dorsett 
filed a lawsuit against the district for the $30^000 and "damages," 

Supt, Trice said the project had achieved its primary purpose — to effec=- 
tively reduce the dropout rate, "Only 8 out of 800 potential dropouts have 
left the school during the past two years. The normal dropout rate for this 
group is 25%"or 200," Trice said. Although he dismissed the testing inci^ 
dent as minor, but unfortunate , Dorsett did not receive a second year's con= 
tract to continue operating the Rapid Learning Centers. 

Instead s after competitive biddings the contract was given to Educational 
Development Laboratory (EDL) ^ a division of the McGraW'-Hill Publishing Go, 
EDL charged $300 per student per grade galn-^more than three times the Dorsett 
fee* At the end of the second year of the project^-tha 1970=71 school year^^ 
EDL* s own test scores indicated substantial improvement in student learning* 
But, standardiEed achievement test gains were low* Overalls the mean score 
was p 48 of a grade level advance in reading and ,31 in mathi In 1971^72, 
the two districts dropped EDL and took over the operation of the Rapid Learn^ 
ing Centers thamselves. Trice says it is continuing to achieve its prlrne 
goal-"-to reduce the dropout rate substantially. (The Texarkana project is 
discussed at length in Volume //3 of the Rand Gorp*-s Case Studies of EducatiQnal 
Performance Contracting , ) 
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TEXARKANA FOLLOW-UPS 



During the 1970-71 school year several districts joined Texarkana in 
attempting performance contract projects. Most of them were planned during 
the spring of 1970^ when results from Texarkana were being publiclEed; there-- 
fore J most of them resembled Texarkana* If they differed from Texarkana ^ they 
were usually simpler, dlspenaing with one or more facets of the Texarkana 
experiment. Some did their own testings instead of hiring an outside evaluator. 
Several did not hire an educational auditor. Several dispensed with bidding. 

But virtually all projectB employed private corporations to teach dis- 
advantaged students for one school year. Virtually all projects paid the con-- 
tractor according to student achievement gains on standardised achievement tests. 

Large and smalls there may have been as many as 50 performance contracts 
during 1970-71. The Banneker project In Gary, Ind., OEO experiments in 18 
cities, and three contracts in Grand Rapids are described in subsequent chapters* 

Briefly noted, here are some others ; 



Philadelphia 

Unlike contracts in which the private corporation controls the learning 
environment, in Philadelphia the contractor supplied materials and teacher 
training to over 500 teachers, Otherwise, the contractor—BEL— had little = 
contrDl over teachers or classroomB. Essentially ^ BRL guaranteed the effec^ 
tiveneas of its Project READ materials. 

Fifteen thousand students from Philadelphia's inner-city District #4 
including all primary school youngsters and all underachlevers in grades 4=7, 
participated in "Project Read^G." BRL promised one year*s achievement for 
every child who attended school 150 days* If students attended less, BRL 
received a flat fee of $20. If students achieved one year's gain, BRL received 
a fee of $40, If students failed to achieve one year's gain, BRL received 
no payment. 

The results split in thlrdsi 5,000 puplis did not attend 150 days. Of 
those who did, 5,000 achieved a year's gain, 5,000 did not. For the total 
enrollment in the project of 15,000, the mean score in reading achievement 
gain was 0*9 years. BRL claimed these results were "probably the finest 
resulte ever achieved in an inner city," Financially, BRL received the same 
as it would have If it sold Project RE^ at its customary price of $20 per 
Q Student i However, Education Turnkey Systems did its own evaluation of the 
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project and concluded that sturients gained as much as one grade level above 
chat reporced and that students with IQs below 75 did becter than those with 
IQs above 75 . 

Virginia 

In competitive bidding, Learning Research Associates (LRA) was awarded 
a seven-month contract In seven Virginia counties. Events here were similar 
to those in the second year at Texarkanai the contractor's own testing in- 
dicated considerable success, but the standardized testing revealed an average 
gain of less than 0.5 years. All seven districts continued the contractor's 
techniques into 1971-72, but without the contractor. 



le contract in Norfolk, Va. , is the subject of Rand Corp.'s Case 
Studies^ in Educational Performanee Contracting , Voluine #2.) 



Colorado 

The Colorado State Dept. of Education decided to experiment with perfor- 
mance contracting. Without competitive bidding. It selected Dorsett Educational 
Systems. Rapid Laarnlng Centers were constructed in three Denver area suburbs, 
each to serve 100 underachieving Junior high school students. Dorsett claims 
to have succeeded in getting an average of one year's gain in math and reading 
in 80 hours of instruction at each of the sites. In fact^ says Charles Zart- 
man, ^director of research and development for the Englewood schools, "although 
the 'Hawthorne Effect' could account for soma of the growth, it seems reason- 
able to conclude that the program itself accounted for a considerable portion 
of the 400-plus per cent improvement over last year's performance." 

Providence, R.I. 

In the summer of 1971, AFT briefly revived the teaching-to-the-test 
charges first heard the year before In Tescarkana. The APT pointed to "wrong- 
doing" in Providence, R.l. The contractor. New Century, a division of Meredith 
Corp., had introduced a new vocabulary textbook which contained a high coin- 
cidence of vocabulary test items— just two weeks prior to the posttest. How- 
ever, the posttest scores were low and New Century lost money. The Institute 
for Development of EduGatlonal Auditing, in its Independent audit, disagreed 
with AFT's charge. It said it found no evidence of teaching to the test. 

Others 

There ware other projects In the Texarkana molds EDL had contracts in 
Flint and Muskegon Heights, Mich., and San Dlegoi BRL had one in Monroe, Mich.; 
CO /MBS, in addition to its Grand Rapids site, had a contract in Greenville, 
S.C,5 Educational Solutions had one in Boston, Mass., and one in Oakland, 
Calif.; Westinghousa Learning Corp. had a small contract in Gilroy, Calif, 
(the subject of Rand's Case Study #5); Webster Division of McGraw-Hill claimed 
ERXC ^^^^ contracts, but refused to say where. 



THE OEO EXPERIMENT 



In the glow of the flrat published test scores from Texarkana, hundreds 
of educators traveled there 5 Including OEO's Jeffry Schiller and Charles 
Stalford, They returned to Washington , excited by what they had seen* By 
April I97O5 they had designed a hationwlde experiment to "scientifically" 
evaluate whether perfomance contracting was of value. Three months later, 
the $5,7 million experimant was announced to the world amidst great fanfare. 
Eighteen months afterward^ on Jan* 31, 1972s OEO announced its verdict 1 
Performance contracting had ''failed." 

The Beginnings 

GEO consciously imitated what appeared to be the new "panacea" in Tex-- 
arkana* In the words of CEO's final report 5 its decision to experiment came 
as "great enthusiasm and optimism greeted reports that a new progrmi, called 
performance contracting, was succeeding beyond anyone's wildest hopes with 
poor children in TeKarkana." GEO found performance contracting an attractive 
concept^ the report said 5 because of Its emphaBis on outputs (i.e., test 
scores) J its promise for aiding poor children and "Indications that performance 
Cdntracting would become a fad," 

Some observers belieye the decision to proceed with the experiment had 
approval from the White House, However, others disagree. The announcement 
of the project itself reflected Pres, Nixon's language in his March 3, 1970, 
address to Congress in which he prompted educators to pursue "accountability" 
for "equality of results" in education. As journalist Fred Hechinger noted 
in the Feb, 6^ 1972^ New York Times , "Performance contracting had all the 
qualities normally admired by the Nixon Administration # Under ^ the concept 5 
private Industry, . .would go into the schools and. In return for a feej attempt 
to raise the l^vel of student achievement , particularly among the disadvantaged. 
If a contracting company failed to produce the level agreed upon with a local 
school board, it would refund part of the fee* The money-back guarantee is 
as toerican as apple pie»" 

When John 0. Wilson ^ CEO's former director of planning, research and 
evaluation, announced the project In July 1970, he offered this observation 1 
"Varidus educational innovations that show great promise are being developed 
by private industry. In effect j" he added, "the techniques promise that, for 
the first time, education will be able to promise 'equality of results'! that 
ways can be found to bring poor children up to a level of achievement compara- 
ble to that of their nonpoor classmates j and that those providing the educa- 
tion will not be paid if 'equality of results' is not provided J' 



OEO's rationale was revealedj for eKamples in a Sapt, 23, 1970j speech to 
the San Francisco Chamber of Conmierce by Donmld Rumsfeld, director of OEO; 

rrom the standpoint of potential educational reformj the most Blgniflcant 
feature of this concept is accountability i no success^ no payi Contractors 
are paid only to the extant that they are successful in improving the educa= 
tional skills of the children they instruct. In the experiment, the contrac- 
tors will be paid only if they increase skills by more than one grade level. 
They will make a profit only if skills increase by 1,6 grade levels ^ nearly 
four times the average now attained in schools serving poor neighborhooda , " 

In shorts what Wilson and Rumsfeld were saying is that the project would 
demonstrate that better education could be purchased for the same moneys be^ 
cause free enterprise would be more capable than public schools. 

This struck directly at the oft-heard argument from NEA, AFT and government 
officials that mora federal money is the key to educational Improvement. Said 
Rumsfeld: "Let thex-^ b.^ no doubt about It— a major effort has been mounted by 
a handful of self^-appoiuied education spokesmen to halt any inquiry into 
the possibility of educational reform,,,. They fear experiTOentatlon because 
it may call into question their dogmas and orthodoxies . I doubt that these 
people speak for most teacaers*.,, I*m sure that many teachers ,,, are frustrated 
by the rigidities of their professional organisations " 

In the early weeks of the OEO eKperiment^ the success of the project 
was presumed. It seemed to be a demonstration , not an experiment- As noted 
by Education Digest in November 1970, "The OEO has awarded 18 contracts of 
this kind that are hailed, of course, as harbingers of the future, even before 
they have been completed and evaluated*" 

Albert Shankarj president of the United Federation of Teachers in New York 
City J told Efrem Sigel of toowledge Industry Publications; "This isn't viewed 
as an experiment^ it's a juggernaut. Everyone's going around saying it will 
succeed*" He labeled the experiment a "phony." 

The Dasign of the Experlmeht and Its Problemi 

GEO Intended to select , from among educational technology companies 
bidding on the contracts, six companies with proposale "representing a range 
of Innovative techniques , " 

OEO eKpected that companies would "guarantee" learning gains similar to 
those being achieved Caccordlng to press reports) in Texarkana. AIsq^ the 
companies had to present reaaonable budgets 5 since OEO wished to demonstrate 
that better results could be achieved at costs comparable to those of public 
schools , 

Each company would be assigned to teach , using the methods in its pro^ 
posalp in three cities. In each city, a company would teach 600 underachieve 
Ing students--*-100 each in grades 1,2, 3 and 7| 8^ 9, In each city, there 
would be a matched control group. An outside evaluater would administer the 
identical standardized achievement teat in all 18 cities to the more than 20,000 
students involved* 



19 



As In Texarkana, the difference between pretesu and posttest would be 
the "gain" for each student. Comparison of gains between '■eKperimental" and 
"control" students would reveal the effectiveness of performance contracting. 



OEO ContractriiS Emphasize Various ApprQachea 

Here's how the six contractors in the OilO eKperiment used student in- 
centlveSj teaching machines, and/or reorganized texts and workbooks in their 
18 projects I 



Incentiv^^^s 



Teaching 
Machines 



Reorganised Text 
and Workbooks 



Alpha Learning Corp . 
Hartford, Conn, 
Grand Rapids, Mich. 
Taft, Tex, 



Heavy 



Light 



Heavy 



Learning Foundations 
Bronx, N*Y. 
Duval County, Fla. 
Hammond , Ind , 



Heavy 



Heavy 



Light 



Plan Education Centers 
Athena , Ga . 
Selmerj Tenn, 
Wichita, Kan. 



Light 



Light 



Heavy 



Quality Educational Development 
Anchorages Alaska 
Dallas, Tex. 
Rockland ^ Maine 



Medium 



Medium 



Medium 



Singer/Graflex 
M iComb , Mils . 
Portland, Maine 
Seattle, Wash* 



Heavy 



Medium 



Medium 



Wastinghouse Learning Corpi 
Fresno, Calif , 
Las Vegas, Nev. 
Philadelphia, Pa, 



Medium 



Medium 



Heavy 



Because the experiment was conducted in steadfast secrecy— the school 
systems and companies were sworn not to reveal information unless It cleared 
through OEO==very few outiiders were aware of the many problems ^ delays and 
changes that affected the project. 

When OEO issued its report of ■■failure" it came as a surprise to almost 
everyone ^ '^'ause, from the beginning of the experiment, spokesmen for OEO 
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had given a favorable Impression. One periodical on education, for ex^mDle 
reported in May 1971i " ■ f > 

Perfortnance contracting may be successful in helping children learn, 
especially at the elementary school level. This la the tentative 
conclusion being voiced by officials at the Office of Economic Op- 
portunity who are working with OEO's $6.3 million experiment in 
perforinance contracting. Project Director Charles Stalford says 
preliminary Indications show that elementary teachers may te morB 
willing to work with performance contracting because It seems to 
be particularly successful In motivating younger children. "You 
can't turn older kids around that quickly," he says. OEO's ex- 
perimental research chief, Jeffry Schiller, agrees. Wricing in ' 

May American Education. Schiller says elementary school .young- 
sters in perfoimance contracting are discovering that school can' 
be fun. He notes that a number of habitual truants have been 
coming to school for the first time-=if only for their performance 
contracting classes , 

However, one employe designated by each of the 18 districts as project 
director knew the problems. Occasionally one would hint at them off the 
record, but the media were generally unaware of the problems Later- the 
project directors prepared a chapter to be included in the final DEO 'report 
which enumerated and discussed the difficulties. However, the project dir- 
ectors^^ chapter was left out when OEO issued its "Preliminary Summary of Re= 
Suits, OEO said It would appear in a later report. 

Here are some of the problems pinpointed by the project directors and 
other observers; 



OEO had assumed that, beginning in July, companies could hire staff 
purchase materials, train staff, etc.. in time to compete with convin= 
tional instruction in September. However, many contractors could not 
do this. Their programs did not operate to their satisfaction until 
November or later. They had to hire staff from the sraall pool of people 
who had been left when public schools did their hiring in the spring- 
several contractors received no cooperation from local school districts 
and had to recruit by newspaper ads and the like. Often, materials 
could not be delivered in time for staff training or for the beginning 
of school. In several sites, praservice training was cut short or was 
.. ineptly, handled . 

OEO had assumed that the sIk companies could capably employ, immediately 
all the techniques in their proposals. However, many contractors could 
not do this right away. After all, they were young companies who had 
never taught extensively in public schools before. Three of them were 
m the business of operating tutorial centers in shopping malls where 
parents bring students for remedial instructioni one was a publisher- 
one was a Job Corps contractor; and one's major effort was in teacher 
training seminars. Some companies offered techniques in their proposals 
which they had never used themselves • once selected, contractors had to 
develop their capabilities as they went along. Some of the contractors 
initially proved incapable of teaching first graders. 
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e OEO beliaved that the companies could confidently predict the learning 
gain they could "guarantee , " In fact , few learning companies would at^ 
tempt this* As a rule, learning companies are recent, with a meager 
track record in the use of their teaching materials in public school 
sett.'ngs, "Guarantees" in the OEO experiment had to be ad hoc educated 
guesses ^ influenced by the (inaccurate) press reports from Texarkana . 

• OEO had assmied that its six companies would teach very differently from 
each other and from the ways public schools teach. However , in some 
cities s contractors' programs were similar to public school remedial 
prograirts. All six companies relied upon programmed instruction, re- 
organized classrooms with differentiated staffing and some kind of stu^ 
dent incentive system* 

• OEO assumed that using standardized tests exclusively would yield ade- 
quate information for a scientific evaluation of performanee contract^ 
ing . In fact, many ot the nation's testing expertS"lncludlng OEO's 
own evaluator-^dispute this, (See "Testing" chapter, p,49i) 

• OEO assumed that, beginning in mid-August, wheu the contract was signed, 
its testing and evaluation contractor could administer its testing pro- 
gram satisfactorily. In fact^ OEO hired Battelle Memorial Institute on 
Aug, 10, 1970, to operate a national testing program* '^o weeks later , 
Battelle began test administration* According to Battelle and the proj^ 
ect directors, inadequate preparation and other unforeeeen problems 
marred the initial testing* 

■ 

Seeking Political VIetory 

From the simiraer of 1970 until the winter of 1971-72^ OEO*s star fell 
in the Washington constellation, reaching its nadir in December 1971, when 
Pres. Nixon vetoed OEO*s appropriation (as part of the child care bill) and 
announced his intention to give 010 a "new role," 

Tb^ preliminary results of the OEO experiment had been promised during 
the summer of 1971 , but their month-by^month delay raised suspicions that OEO 
did not want to release the data. They were finally released on Jan, 31j 1972, 
only after the Seattle schools sued OEO for the information. 

In these circ^stances , it seemed plausible to many informed observers 
that OEO sought to wrench some kind of political victory from its release of 
data. This supposition is supported by journalist Peter Janssen's article 
in Saturday Review > "OEO as Innovator," which appeared the s^e week as OEO's 
results t Janssen concludes that "OEO 'a programs are not likely to make pQ= 
litical waves in an election year,... For its part, OEO is no longer pulling 
rabbits out of hats. It is consolidating, regrouping, trying to survive*" 

Janssen quotes John 0, Wilsoni "With performance contracting and 
vouchers we got rapidly into the area of institutional change. We tested the 
water, got new ideas into the arenas forced people to think of alternatives. 
We went after high visibility. Of course, we didn't want our visibility to 
that high." 

EKLC 22 



OEO's Announcenient 



When OEO released the results of it 



contractors 



edueatlonal methoda did equally poorly 



s experiment it said that all the 



The single most important question for all concerned with the experiment 
xs: Was performance contracting more successful than traditional class- 
room methods m improving the reading and math skills of poor children? 
The answer Is : No . . ' 



• While we judge this experiment to be a success In terms of the informa- 
tion it can offer about the capabilities of performance contractors it 
IS clearly another failure in our search for means of helping poor and 
disadvantaged youngsters to develop) the skills they need to lift them- 
selves out of poverty, 

OEO pronounced Its experiment an unqualified success (because It "proved" 

something, i.e.,^in this case that performance contracting was "useless" to 

schools). OEO then made light Of any problems it mght hive caused. The 

"i"" f experiments was laid on performance contracting, 
the contractors charged, " ^1-^*15* 

OEO stressed the following chart 1 

— Meaii Gains of Experimental and Control Students Across All 18 Sit 

Reading 

Experimenta l Gain Contro l Gain Diff 



es ■ 



erence 



Grade 1 nA 

2 .4 

3 .3 
/ .4 

8 .9 

9 .8 



EKperlmental Gain 

Grade 1 . NA 

2 .5 

3 .4 

7 .6 

8 .8 

9 .8 



NA 
.5 
.2 
.3 
1.0 
.8 



NA 
-.1 
+ .1 
+ .1 
-.1 



Math 



Control Gain 

NA 
.5 
.4 
.6 
1.0 
.8 



Difference 
NA 

-.2 



NA: A readiness test, rathar than an achievement test, was used as the 
first grade pretest. There is no grade equivalent for the 



test, 



le readiness 



erJc 



23 



Using this chart, OEO concluded that "regardless of the perspective takan, 
performance contracting was not responsible for any significant iinprovetnent 
on an overall basia,-' 

The contractors and others might have eKpactad OEO to ask a very differ- 
ent "single most Important questional Was there any evidence of successful 
teaching by any of the contractors which would yield any new knowledge about 
teaching underachieving students ? By lumping together all sites and all con^ 
tractors, OEO appeared Lo dismiss this question, OEO was not to be satisfied 
with less than a panaceai many observers charged, *'We have not found a panace 
said OEO's director Philip SancheSi OEO then tried to wipe its hands of the 
affair . 

Battelle'a report ^ Issued some days later (although it was available to 
OEO before Jan. 31)* indicated a few successful sites and a few unsuccessful 
ones I but by issuing smmnary results, OEO hid these beneath a statistical 
carpftt , 

Ironically J Battelle, in Its report ^ repudiates the use of grade^equiv^ 
alent scores for evaluation and also rejects the use of pretest/posttest com'- 
parisons of experimental and control groups. That is ^ OEO^s evaluator recom-- 
mends not doing exactly what OEO did 5 observers point out. 

OEO'S chart neglects what inany consider essential informations also. 
It compares "mean" scores for groups without revealing the size of the group, 
the range of scores ^ the distribution of scores ^ or the standard deviation. 
Without this, observers point out, one cannot meaningfully compare ''mean" 
scores, as the chart invites one to do, 

OEO says there were no significant differences, but has chosen to use 
"significant" In a nonscatistical fashion, a contractor said, OEO arbitrarily 
says that significant improvement would require a difference in "mean" scores 
of 0.5 years* In a population of 20,000 stulentSj much smaller increments are 
considered to be statistically '^signif leant . " 

In sum, many observers believe the OEO eKperiment Is more Interesting 
for what it suggests about the interaction of politics and research, about 
the gaps between Washington rhetoric and public school reality, and about 
OEO's news media management, than for what it reveals about the effectiveness 
of performance contracting. 

Indeed, in terms of John Wilson's initial announcement that the project 
would stress accountability^ — -no results, no pay'-^the experiment succeeded 
handsomely. The contractors lost money; some went broke, 

OEO-s conclusion that performance contracting had been proved useless 
for schools was immediately challenged. School officials and companies in- 
volved charge OEO with trying to bury performance contracting on the basis 
of questionable evidence. Supt, Trice of Texarkana says OEO's assertion 
that performance contracting has been found valueless to schools is '*as far 
wrong as can bs." Trice, who developed the nation's pioneer performance 
contracting program, says his eKperience shows that the concept "has a great 
deal of merit . 
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The Stockton and Mesa Experience 



In addition to contracting with six educational technology companies, 
OEO signed performance contractB with three education associations CNEA 
affiliates) , These eKperiments were intended to test whether teachers who 
would give InGentlves to students, and who received incentives themselves 
for student achievement ^ would perform better than conventional teachers. 

One of the three sites was to be Grand Rapids, but teachers there voted 
to reject the invitation which would have placed them ''in a sort of quasi- 
competition with the three learning corporations" at Grand Rapids. OEO 
settled for two teacher contracts, one in Stockton, Calif., one In Mesa, Ariz* 

These, too, were hastily initiated eKperiments, According to the report 
of the two project directors, the contracts were not signed until November 
and the experiment began in December. Selecting 600 ejcperlmental students, 
plus 600 control students during November, with the consequent rearranging of 
schedules and testing of students , reportedly caused ill-feelings and confusion 
which carried into the experiment. 

Prior to OEO's Jan. 31 report, a few statements by the two project 
directors and by OEO officials had indicated some benefit and pleasure with 
these two experiments. But, at the press conference at which the results of 
the 18 projects were released, OEO dismissed Stockton and Mesa as still another 
case of no significant difference between experimental and control groups. 

The project directors at Mesa and Stockton sent OEO a Jointly prepared 
report on their experience • A portion of their comments follows: 

"Visible changes in student behavior may have affected some change in 
teacher attitude as the project progressed. In Mesa^ a questionnaire was 
mailed to each teacher Involved in the project. At the elementary level, 61% 
responded while 62% replied at the junior high level. Most elementary and 
junior high teachers who responded Indicated thati 

• Incentives were effective in stimulating achievement and in modifying 
student behavior. 



« Incentives used were appropriate and usually desired by the student, 

• Student 3 were able to attend to a given task for a siibstantiaJ ly longer 
period of time, 

• It was somewhat difficult to monitor student progress, 

• The attitude toward school of students in incentive classrooms was 
better than the attitude of those in non=lncentive classrooms i 

• Parental reaction at the elementary level was favorable, whereas the 
junior high teachers indicated neither favorable nor unfavorable parent 
reactions (only two parents had unfavorable reactions). 



Teachers favored the use of Incentives with disadvantaged students, 
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Most teachers did undergo, philosophically, some change in attitude 
toward the use of incentives during the time the project was in operation. 



• The majority of teachers favor the performance contracting concept. 

• Most elementary teachers would be willing to participate in another year 
of performance contracting whereas most junior high teachers were unde-- 
cided or gave a qualified "yes-- to another year ; 25% of the junior high 
teachers were definitely not intereeted in another year. 

• Most elementary teachers felt that the project helped whereas most junior 
high teachers indicated that it helped students somewhat during the year; 
approKimately 25% reported that it helped quite a bit* 

A Incentives are still being used at both levels; approximately 45% of the 
elementary teachers are using incentives at the same level or greater 
thaii last year* Most junior high teachers are using incentives at a re- 
duced level because of lack of funds , 

• Pretesting conditions were rated poor with one^third indicating average 
testing conditions * 

• Posttesting conditiona were rated average or above at elementary level, 
and poor at the junior high level, 

''The above data does not adequately reflect the feelinga of the junior 
high teachers. Generally ^ there was a negative attitude toward the program, 
especially the organisation* Since there was no ability grouping, the stu^ 
denta were dispersed among all classes causing the organization to be cumber^ 
some to handle. Although this was true at all levels ^ it was especially dif- 
ficult at the junior high level. It should also be pointed out that the ju- 
nior high faculty and students were on double sessions j attending school only 
in the afternoon. The faculty was heavily Involved in meetings to draw up 
specifications for a new junior high, in designing curriculum, selecting furni-- 
tare, etc. The incentives program was just one more thing they had to do^ 
even though they voted to participate in the program* 

"At the conclusion of the project in Stockton, 87.5% of the participating 
teachers at this project site Indicated tlv they would participate in another 
incentives project. The Stockton Teachers Assn. agreed to support a continuing 
prograni of 'incentives onlyt * Both participating principals agreed to con- 
tinue the program if funding became available," 

The Mesa and Stockton project directors released these recommendations i 

• That any future "incentives only" project be given sufficient time to 

permit screening of classroom teachers • 

• That any future '^incentives only" project be given sufficient time to 

permit adequate preservice and Inservice training, 

• That any future "incentives only" project be made more uniform in pay= 

ment procedures, 

• That any future "incentives only" project involving more than one site 

be designed to provide better control of variables. 
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^ "Four Companies Talk Back-= — — — =^ — 

Four of the six companias involved in the OEO experimental proj- 
ects issued a special report of their o\m following OEO^s interpretations 
and conclusions, The sumniary of their statement^ Jointly prepared by 
the Alpha Learning Systems^ Inc, ; Learning Foundations, Inc.; Plan Edu- 
cation Canters^ Inc; and Singer/Graf lex , Inc., reads as follows: 

The performanca contTacting project cannot realistically be de^ 
scribed as a definitive^ rigorous, experimental investigation of the 
impact of performance contracting in the ramediation of basic learning 
skills of educational achievement among the disadvantaged in general* 
It was actually a very large quasi^experiment , of liinited external 
validity, fraught with start-up dif f icultieSs teacher resistance^ poor 
testing conditions and other problems that adversely affected the ex- 
perlmental groups. Apart from the testing and evaluation inconsisten- 
cies, limitation of^ the experiment to a one-year life term was a aeri-- 
ous mistake. It is conBervatively estimated that the first four months 
- were devoted to reaching the normal September status for experimental 
students. Concurring with the need for a second year for testing of 
the educational innovations introduced by the contractors, many of the 
school districts eKerted efforts to find funding to maintain the pro- 
grains a second year , 

The point must be made that had the contractors known that the 
control groups would not be randomly matched with the experlinental 
groups s had they known that improper levels of achievement tests 
would be used J and that the tests would not be matched with the in^ 
structional programs ^ the contractors would never have entered into 
the OEO performance contracting experiment under such terms* 

The disheartening thing that the contractors *f eel is increased 
polarization between the educational community and the private sector 
just at the time when educational technology has reached a stage of 
development that can produce significant benefits. Private companies 

believe (they) can make a contribution to public education in Mer- 
ica if (they) can work In full cooperation with, and not in opposition 
tOj the existing school systems. 

Issues such as those described in this statement have made the 
contractors Involved in performance contracting conclude that at best 
the results are inconclusive* However, the eKperlment was not without 
value. A number of concerns of those interested in the Impact of new 
technology In the classroom have been Identified and perhaps clarified. 
Emphasis has been given to measurement and the use and misuse of 
achievement tests. Many sweeping generalizations can be put to rest; 
quick cures 5 and short-range demonstrations alike, can be deemed In- 
appropriate to the magnitude of the task, Finally, it is the recom-- 
mendation of the contractors that the base established by this experi- 
ment be built upon for further Investigation. Accountability ^ by 
performance contracting or other means, should proceed under controlied 
experiment a tion and measurement. 
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THE BANNEKiR EXPERIENCE-— SIGNS OF SUCCESS 



The first and only performance contract Involving an entire school was 
established in 1970 at Gary, Ind , 

The site: the Banneker Elementary School. 

The reasons parent and school board dissatisfaction with how the chil- 
dren were learning imder the old systeTn, 

The Banneker contract Involves more mney (well over |2 million) ^ more 
responsibility for the contractor and a longer period of time than any other 
performance contract. 

Banneker has one ot'er important characteristic i After one year's op^ 
eratlonj it Is one of the more successful examples of performance contracting 
at work. 

The Banneker school sits on a large plot of land not far from Gary's gi- 
ant steel mills. It is in a black, working"Class neighborhood where one-third 
of the pupils are from families that receive some welfare assistance* 

Most of the pupils at Banneker had not performed well on standardized 
achievement tests. Of Gary's 33 schools , Banneker ranked 31st on reading and 
math scores* The average 1969-70 sixth grader at Banneker performed at about 
the 4.5 grade level. 

Behavioral Research Laboratories (BRL) of Palo AltOj Calif was selected 
as the contractor 5 with these specific instructions: to set up a four^year 
program which could be turned over to Gary school officials after three years; 
to raise pupil achievement in reading and math by at least one grade level as 
measured by national standardized achievement tests. BRL stlmated the cost 
at roughly $800 per pupil per year. If a child failed tc ichieve a one^year 
gain in a year's time ^ however ^ all the money spent by the district on that 
child would be refunded by BRL. 

The Center for Urban Redevelopment in Education (CURE) in New York City 
was chosen from among several firms as an evaluator to judge each pupil's prog= 
ress through the program. 

Although original program documents called for an auditor , none was ap*^ 
pointed mtll the simmer of 1971. It was announced that Price Waterhouse and 
Co* would audit the testing results and validate the evaluation design. The 
Rand report, Case Studies in Educational Perfor mance Contractin g; ^ar^p Indiana , 
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stated that Price Waterhouse did not certify the ©valuation design or e 
the testing, To quote the Rand report: 



'■Price Waterhouse, in its words prepared a ... computation setting forth 
the net consideration for services rendered at Banneker School for the school 
fiscal year 1970-71 provided under Sections 5 and 7 of the agreement between 
Behavioral Research Laboratoriss and School City of Gary, Ind,, dated Sept, 
22, 1970. This computation was prepared utilizing data obtained from certain 
financial enrollment and attendance records of School City of Gary, IndJ* 



Qoals^ Raaotiona, Results 

These were BH.'s Ideas as eKpressed in Its proposal to the school board i 

• To create a total systems approach to learning in the elementary school 
using all the appropriate, proven techniques of instruction, staff de^ 
velopment, community participation and school management required to 
produce measurable results. 

• To diagnose, prescribe, implement and monitor an individualized educa- 
tional program for each child, using programined instructional materials 
and preservice and inserviee training programs for administrators, 
teachers and paraprof essionals . 

• To allow an independ^^nt evaluator to make a thorough and meticulous eval- 
uation of each child s progress through standardized tests. Results in 
both cognitive and affective areas will be measured carefully, 

• In the daily operation of school, classrooms will be known as learning 
centers and teachers as curriculum managers. Staff will learn to be 
versatile I individual members will change their role and assignments ac= 
cording to the children's needs and progress, and children will progress 
at different rates of speed and will move in and out of centers accord-^ 
ing to schedules set by themselves in consultation with staff. 

• To ineorporate the most effective means of instruction possible .so the 
company can demonstrate that It has produced significant improvement in 
the students' learning. 

The proposal, and later, the contract itself, Indicated that BEL would 
have nearly free reign to apply this "total systems approach," Although BRL 
gave the impression that it was ready and able to do all of this immediately, 
an instant system did not materialise. BRL did have its successful reading 
and math programs, the use of a group of consultants and administrators, and 
a desire to succeed, but like the six companies which contracted with OEO, BRL 
had to continue developing techniques as the project proceeded. 

Because the first six months of the Banneker project were consumed In de= 
velopmental ef f orts^-reorganiElng the school, training staff (and students) in 
new procedures, eKpandlng from reading and math to the total school curriculum, 
and roaklng changes to satisfy the state board of education—it is difficult 
(and possibly misleading) to "freeze" a picture of the Banneker program. 
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Overall, it resemblad Texarkana's project:, but on a much larger scale 
and with highly developed instructional materials* Unlike TeKarkana^s proj- 
ect:, BRL used few audiovisual devices (its own published materials are all 
in workbook form) . Also unlike Texarkanaj BRL did not use ^'contingency man- 
agement" during its first year and preferred to assert that learning is its 
own reward , 

Toward the end of the first year the pace of change lessened* Three ob= 
servers visited Banneker in the spring of 1971 and conveyed a coniposite im^ 
pression of Banneker 'S operations 

Banneker is not run like an ordinary school* For one things it 
uses fewer teachers~24 compared with 34 last year* For another, they 
aren^t known as teachers but as "curriculum nianagerSj" and they are 
aided in class by "learning supervisors J' BRL hired 28 supervisors 
from the consnunity ^ , . . The supervisorB aren't trained as teachers; many 
are parents chosen because of their interest in education. The school 
gets along with fewer teachers because most learning takes place from 
the materials. (Richard James^ Wall Str^ee^t journal ^ June 2, 1971,) 

"I couldn't believe my eyes j " one teacher saidj --when we unpacked 
new materials from BRL and found boxes of dice! However ^ they have been 
marvelous for games that have helped the children in math," In one of 
the older classrooms at least three sets of activities were quietly 
taking place at oncei a championship checker contest , a math relay race 
on the blackboard and a game of modern logic called WFF^ which was so 
complicated I couldn^t begin to understand it even when one student 
explained the rules. (Mary Ann Curtis, Gary Post-Tribune ^ June^ 6^ 
1971.) 

Standing in a Banneker classroom reminds me of a visits years ago, 
to a one^room rural school in lowai The 40 youngsters in Miss Frances 
Butcher's Room 106 are 6 and 7 years old. They are divided into groups, 
like the different grades I saw in lowas each doing its own thing, Don 
Kendrick^ the center manager ^ says of the teaching i "We let the systein 
teach—teaeher should manage. What we want from the teacher is the per- 
sonal touchy talking to the studentSj saying, -Raad to mes' and asking 
'How are you doing?' She can't do that if she has to teach her class 
the old way,'- (Jack Stars Look, June 15 , 1971.) 

Rand Corp#, in its report on Banneker ^ Ca^eStu^les in Education Pgr£or= 
mance ContractinR , stressed two other features at Banneker: Instead of 

once more working with the special education students in special classes, her 
(the special education teacher) main responsibility is working with them in 
their regular classrooms. A few of the most seriously handicapped pupils re- 
ceive separate instruction ^ but for the most part the special education teach^ 
er is an addition to the regular teaching program instead of a substitute 
for it," 

The other feature of Bannekeri "(BRL is to) use, its best efforts to 
implement an effective and meaningful community participation program; to 
send brochures and newsletters to parents explaining the activities of the 
center, disseminating news about the center to local and national medial and 
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to provide parents with special materials to assist their children at home to 
stirnulate learning and achievement , " 

During the first year at Bajinekar, 72,5%, or 396 of the 546 children in 
the progrffli in grades 2-65 made average or better- than-average gains in read- 
ing , mathematics or botht Thirty- two per cent , or 176 pupils, made 1,5 years' 
gain or more. In addition, 90%, or 72 of 80 kindergarten children in the pro- 
gr^, scored at or above national academic -'readiness-' norms, indicating the 
likelihood of their future success in school. 

In the 1970=71 school year, student performance was measured in terms of 
gains between October. 1 and June 1 administrations of the Metropolitan Achieve- 
ment Tests. The 546 pupils measured in grades 2-6 in the Banneker program 
averaged 9,5 months growth in both reading and mathematics during the eight 
months between the two tests. 

Reaction of Parents 

Before the start of the program, transfers out of and into the school 
were permitted. These were allowed because Banneker -s enrollment of 737 pu= 
pils was below the 800 desired for the program. Many parents wanted their 
children in the program, including some parents who apparently sought the 
program for their above-average children because they apparently felt it would 
offer more of a challenge than a conventional school* And^ as the Rand report, 
noted J many parents with children who were having trouble in school transfRrred 
them in the hope of improvement * 

Staff Ratios Changed 

During the 1969-^70 school ybbt , Banneker had 32,5 staff members, Wxvm 
teachers were selected as curriculum managers and 16 as assistant curriculum 
managers. The teachers were not involved in the development of selection 
criteria and did not know the basis for selection. To bring the staff to 
size for the program, several teachers were transferred to other schools (the 
transfers were not taken lightly). 

The transfers left 21 licensed teachers in the school. In addition, 21 
f^ll^tim.e paraprofesaional aides were hired as learning supervisors at rates 
of $1,75 to $2.05 an hour for a normal workday of six hours , five days a week. 
The project substituted the aides and considerable materials for 13 certificated 
teachers J resulting in a much lower persdnnel cost* 

By the end of the spring semester^ there were more certificated teachers 
at Banneker than planned. As of June 19 71 5 Banneker had 23,5 certificated 
teachers J plus two full-time substitutes. The substitutes filled in for the 
curricul™ managers a half-day a week to permit the managera time to develop 
materials . ) 

On the teaching level, there were five teachers (curriculum managers) who 
ware responsible for one of the areas of the reading and language arts^ 
mathematics s social studies and foreign languages ^ aciences and enrichment* 
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ihe other certificated teachers were designated as assistant curriculum 
managers with classroom Instruction their primary responsibility. Each class^ 
room had a paraprof essional or learning supervisor* 

To make it jell, BRL named Don Kendrickj a systems analyst with eKperi- 
ence in the Air Force and at Lockheed Misallaa and Spaca Co,, '^canter manager*" 
Gary school officials appointed Clarence Benfordj a former principal at Banneker, 
"learning director * " 

Organizing the Leaming Program 

BRL stressed the ungraded nature of their program and , therefore ^ tried 
to do away with Banneker^s conventional system of six grades. BRL set up 
small groups organized around various materials. The day was organized on 
the basis of 20-^minute modules of instruction. Within a classroom ^ children 
could move from group to group for instruction in various aspects of a sub^ 
Ject, As a pupil mastered a given body of material, he could be moved into 
a new group rather than having to wait for a semester break. 

At the starts the program was almost exclusively devoted to reading and 
math, and organized around the Sullivan series of programmed workbooks and 
materials. By the spring semester (1971)3 social sciences and science were 
being taught. The time allocation among subjects remained somewhat different 
than the conventional program* More time was devoted to reading and math than 
in the typical Indiana school » 

The^ materials used for social science and science were conventional 
teKts . Instructional techniques were also relatively conventional* In ad= 
dltion to the Sullivan materials , the major texts used were those published 
by the American Assn, for the Advancement of Science and Science Materials, 
the Allyn and Bacon Social Studies Progr^i and Man ^ A C qur^e g f S t udy , 

BRL originally planned to Inform parents of their children -s progress 
through detailed 5 complete documents which were to describe the advancement 
of thm pupil through the assigned materials- Difficulties in developing such 
an instrument and parental confusion about how to interpret the reports led 
to a simpler but still distinctive document. The report card uses a marking 
system based on the rate of skill acquisition. 

Problems Encountered 

The first semester did not fulfill BRL^s Initial promises. A legal bat- 
tle between school officials and the teachers union ^ which started before 
classes opened ^ boiled over alleged contract violations. 

A dispute with the state of Indiana climaxed with Banneker's decommis- 
sioning (removal from the state list of certified schools) in February. The 
union was irritated by the reduction of certified teachers | the state was upset 
by the increased teacher^pupil ratio and by the revised curriculum. Morale 
became a problem and rumors reached the newspapers that teachers were threatening 
to quit, Paraprof esslonals in the school organized and threatened to strike. 




32 



The Union Objeeta 



RJC 



BRL's arrival was caken by the Ameriean Federation of Teachers (AFT) as 
still another taunt in the history of conflicts with Gary school of ficials . 
Essentially, the union objected to an insufficient number of teachers, forced 
transfers of 13 teaGhers, the use of paraprof essionala who, the union said 
served as teachers, and a newly adopted policy at Banneker of transferring' 
teachers on 15-days ' notice. The final objection centered around the union's 
reasonxng that the use of two levels of teacher responsibility and two aehedule 
of overtime, plus BRL's ability to promote or demote teachers, resulted in 
hidden merit or incentive pay. 

In October 1970, the union infonned school officials it had voted to 
strike. The Rand report notes there was considerable conimunity pressure 
against the strike. In addition, a court injunction was sought and given to 
school officials to bar a walkout. 

The strike by the AFT and the Gary Teachers Union never materialized and 
a grievance alleging three basic vifilations was filed October 21 against the 
Gary Board of Education. It alleged that the ratio of pupils to certificat-d 
staff, the forced transfers and the 15-day involuntary transfer rule were all 
violations of the contract. 

The dispute tumbled into arbitration— minus school officials who refused 
to participate— and resulted in a finding essentially in favor of the union 
And that is about as far as it went— no strike transpired, school officials 
successfully ignored the union and the union niore or less became reconciled 
to the program as It progressed. 

The State of Indiana Objects 

The tussle with the state of Indiana goes back to what some say was a 
personal animosity between Gordon McAndrew, Gary's school superintendent 
and Richard Wells, then state superintendent of public Instruction. (Weils 
was a Gary school teacher before being elected superintendent and during the 
period of the dispute he was still on Gary school rolls with on-leave status 
Wells was generally critical of private contracting for school services He' 
was defeated for reelection in the fall of 1970. by John Laughlln who is on 
record as being generally favorable to the Banneker program.) 

The legal battle started with a letter to Wells from the Gary school 
board outlining the project and requesting permission to proceed. By return 
latter. Wells' office said It was illegal. This did not stop Banneker, how- 
ever, so the Indiana State Department of Education initiated an investittation 
of the program. 

John Hand, state assistant superintendent for instruction, led the in- 
vestigation and submitted to the state school board a separate personal opin- 
ion about the project. "There Is nothing uniquely innovative about the Banneker 
prugrara eKcept the abdication of professional responsibility on the part of 
school city of Gary and the placement of primary emphasis upon building and 
maintaining a systems model Instead of upon the children and their needs " 
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The school was dropped as an official school in the State of Indiana 
(thus being ineligible for state aid) in February and changes were rapidly 
made in the school. Much of the hassle was settled behind the scenes, and 
when Gov- Edgar Whitcomb visited the school he pronounced it a worthy eKperi=- 
mentt In March the school was recomiissioned , subject to periodic reexamina^ 
tion. From February to May, the curriculum shaped up, the furor died, teachers 
became happier and visitors to the school, including Handj had condeinned 

it in February , became cautiously optimistic , In the spring , BEL replaced 
Kandrick with Brian Fitch^ who started mending fences. He spoke of the project 
as a Joint effort between school people and systems developers to build an 
instructional system. The faculty liked him; no one submitted a resignation 
as had been threatened the winter before, Clarence Benford requested transfer 
and was replaced by Sherman Newell , Gary's Teacher Corps director. 

During the summer of 1971, Fitch began to refine the system. Eighteen 
teachers worked under his direction for two months and prepared detailed cur- 
riculum guides for the entire language and math curriculum* First the behav^ 
ioral objectives were reexamined and expanded. Then, teachers searched 
through BRL materials, all the other materials prescribed by the state text- 
book conmission^ and their own files to put together three or more Individual^ 
izad instructional activities for each of the hundreds of objectives. 



In Summary 

On September 24, 1971 5 the test results were released. The press re- 
lease accompanying the results said in part: "Banneker was the next lowest 
achieving elementary school in Gary prior to this new program in September 
1970* Seventy-five per cent of the school's graduates were below grade lev^ 
el in reading and mathematics* Given the present rate of gain in the new 
program at Banneker ^ that statistic will be reversed and children now In 
the primary grades will graduate from Banneker performing at or above grade 
level." 

The news media accepted the test data verbatim^ even though a cursory 
examination reveals that the reporting method certainly accentuated the positive * 

The difficulties of the first year were carefully alluded to in the 
press release, "As encouraging as the first year's results arej no defini- 
tive conclusions will be drawn at this time^" Supt. McAndrew said. "Up to 
now much effort has gone into organizing this new program and making improve- 
ments," BRL Pres * George Stern said "the program's first year results dem^ 
onstrate enormous effort by teachers , parents, students, adminiBtrators and 
all others in Gary concerned with the welfare of the public schools. We have 
never worked with a more dedicated and responsible group of educators. We 
all still have a lot more work to do. But considering the kind of energy 
everyone is putting into the Banneker program, nothing but success is possible," 

Perhaps of more importance than the test scores, the following data were 
also reported I 

As part of the evaluation by CURE (Center for Urban Development in Edu- 
cation) , parents' reactions to the program were surveyed. Eighty-seven per 
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cent of the parents felt that the Banneker progra-i should be continued, Sev^ 
enty-nlne per cent thought their children had made greater improvemenc this 
year than last year in readingi 84%, in mathematics. In addition, 751 to 81% 
of the parents said their children had made good progress this year in social 
studies, science, art and music. Seventy-one per cent of the parents noted 
that their children read more at home, 79% indicated that their children 
talked more about school and 78% said their children liked school more. 

CURE interviewed each staff member and reported that both ''curriculum 
managers" and '-learning supervisors" expressed a unanimous desire to continue 
the program into the next school year and wanted to return to Banneker. 

Gary's test scores are quite impressive when they are compared to those 
of other performance contractors, as in the following chart , partieularlv in 
light of the many conflicts and problems during the first months. 



MEAN GAINS ON STANDARDIZED TESTS 



LSC 



Test Useda 



Gary 



Mean Gains 



BRL 
BRL 



MAT 
MAT 



Gilroy 



WLC 
WLG 

WLC 



0.7/1,7 
0.7/1*2 



Remarks 



Grand Rkplds Alpha " Various 



SAT 0,6 
SAT 0.8 
_MAT (Readlna)0.6 



Reading/math,, first grade 
Reading/m ath, gra des 2-6 



CMES 

WLC 

WLC 



Norfolk 



LRA 
LRA 



Texarkana 



EDS 
MAT 
MAT 

Various^ 
Various 



NRb 

1.2/1,0^ 
O.7C 

0.6^ 



Reading — for contract payment* 
Math=-for contract payment 
Regular district test 
Test Identification not re- 
leased by OEO. Three tests used. 
Readlng/inath 
Reading/math 
Math 



0.1 

0.5 



Dorse tt ITBS 
Dorsett SM 
EDL ITBS 



NR 
NR 

0,5/0.3 



Fifth grade 

Seventh and ninth grades 

Arkansas 

TeKas 

Arkansas and Texas, reading/ 
math, grades 6-12 



Test abbreviationi 



MAT- 
SAT I 
Em I 

ITBS: 
SRA: 



Metropolitan Achievement Test 
Stanford Achievement Test 

Educational Development Serier., Scholastic 
Testing Service 
Iowa Test of Basic Skills 
Science Research Associates Achievement Te? 



^NR: data not released. 

CMean gains for those students who attended at least 150 days and for whom pre- 
^ and post-test scores are available. 
Three tests used at each grade, chosen from SAT, MT, ITBS, California Achieve- 

T i ^f^Stanford Reading Achievement, Means computed only for students 

who took both a pretest and posttast. 
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The ^erican Federation of Teachers (AFT) and Gary Teachers Union re- 
acted skeptically to the data from Gary. They attacked the 72.5% figure re^ 
laased by BRL as the percentage of Banneker students who made average or 
better than average gains in reading or math or both* AFT and the local 
union called the figure a "calculated deception" and "a case of administra'- 
tlve statistic juggling and a neat public relations job on top of it,'- AFT 
said only 6 in 10 students made the year^f or-^a'-year gain in mathematics, 
while only 4 out of 10 did so in reading* 

Several observera raised questione about the cost of the Banneker pro^ 
gram; the AFT pursued this more vehemently than most. From the beginning, 
Gary school officials insisted the program "costs no more" than the average 
per-pupil expenditure, K-^IZ, in Gary. But' K=12 costs in Gary exceed 
costs by perhaps $100 per student. Thus ^ if BRL were paid on the basis of 
eleinentary school costs alone ^ BRL would receive less mbney. 

If BRL does not achieve 100% success— say BRL only achieves 80% of its 
guarantee — tens of thousands of dollars will be returned* Therefore^ the 
real cost to taKpayers cannot be determined until the end of the third year* 
(Should BRL's overall effect be mediocre, the real cost of Banneker to Gary's 
taKpayers will be very cheap,) 

But despite charges about costs, there is optimism about the Banneker 
program . 

Brian Fitch reported extreme pleasure at the way the new system had 
operated, observera from the state seemed to be pleased and school system 
personnel have expressed optimism. 
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GRAND RAPIDS— THREE COMPANliS COMPETE IN FERTILE SOIL 
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Grand Rapids, Michigan -s second largest city, was the site of threa 
parformance contract projects operating in -six schools in 1970-71. They were 
directed by three private corpora tlons-^Alpha Learning Corp., Westinghouse 
Learning Corp* and Combined Motivation Education Systems (CO/>ES) . In 1971-72 
a second generation of projects with these same companies was operating in 
14 iichools , 

One of the compf.nies , Alpha Learning Corp,^ came to Grand Rapids as part 
of OEO's 20 national experiinents in performance contracting* It turned out 
to be the most successful of the three sites assigned to Alpha by OEO. Even 
though OEO delayed the release of test results until long after school began 
in 1971=72, Alpha's program had linpresied Grand Rapids so much that the dis- 
trict renewed one performance contract with Alpha/ started another contract 
and gave Alpha a fixed fee contract as consultant to several schools which 
wanted to adopt some of Alpha's techniques. Alpha also acquir&d projects in 
three oth^ir Michigan cities. 

Westinghouse held a performance eontract to establish learning centers 
in two Grand Rapids elementary schools. When faculties of two neighboring 
schools requested that Westinghouse learning centers be placed in their schools 
also, the centers were added on a fixed contract basis in February 1971. 

Tqsl results in June 1971 Indicated that both pairs of Westinghouse 
learniiig centers^-the two on performance contracts , Lexington and Franklin, 
ard the two on fixed fee contracts— achieved comparable results. Tests were 
administered to students in June and compared with results from pretests 
Actual gains were adjusted to read as grade gains. That is, a student gain 
of .6 in a half year became a gain of 1.2 grade levels. Lexington School 
students showed a gain of 1.2 grades in reading and .95 in math- Franklin 
School students did slightly better with a gain of 1,3 grade levels in read- 
ing and 1,5 in math. This overall gain bettered that of the old program in 
the previous year by about .6 of a grade level. Because of these promising 
results, the number of schools in the program expanded to six, in 1971-^72, 
all on fixed fee contracts. (Westinghouse disbanded its contract learning 
operations, but the same personnel and proeedures are now incorporated as 
Learning Unldmited,) 

The third company in Grand Rapids-=CO/>ffiS~established Its learning center 
^^.^^l"^'^!^^^ South Middle School. CO/MlS promised to raise reading and math 
abilities of low achievers by two grade levels in one year. Normally, students 
at the school gain ,7 grade levels per year and the low achievers assigned to 
CO/MS would be expectad to achieve even less. 
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CO/^ffiS did not achieve its ambitious goali Participating students gained 
1.2 grade levels in reading and 1.0 grade level in math, double what South 
Middle School accomplishes on its own. However, since the results fell far 
short of the contracted guarantee, CO/lffiS, like several other learning compa- 
nies, found Its first project deep In red ink. Despite this setback, CO/fflS 
returned to South Middle School in 1971^72, but under a more realistic contract, 

Here-s how Elmer Vruggink, assistant superintendent for instruction in 
Grand Rapids, answered a question on results of the first year of contracting 
in Grand Rapids i 

Q* What are some of the values you see in the program at the end of one 
year? 

A. • Improvement in perforB^nce in reading and mathematics as measured 
by standardised tests. 

• Reduced dropout percentage in the schools that now use performance 

contracting * 

• Encouragemant of self--paced and IndividualiEed Instruction. 

• Encouragement for Internal reform. Some Ideas are already being 

generatad among staffs that will change the style of teaching in 
Grand Rapids when contractors leave and "turnkey*- (turn the keys 
of the program over to the school) the process* 



Why fhe Salutary Results 

Considering the mlKed success of performance contracts in other cities, 
considering that most cities in the 1971^72 OEO experiment did not continue 
the projects, considering that nsny other contracts elsewhere were dropped 
after the first year, what contributed to salutary results in Grand Rapids? 

No doubt thfc techniques employed by the contractors contributed to their 
achievements. None of the contractors were publishers. Instead of using pro^ 
prletary materials (BHL-emphasized Project R^^ and Project MATH; ©L-McGraw 
Hill emphasised its Learning 100), the companies selected their teaching ma'^ 
terials from diverse sources. Alpha and Westinghouse emphasized paper and 
pencil programed materials and constructed classrooms in which students 
worked individually at desks or tables * CO/MES emphaslged cassette players 
and teaching mchines and built classrooma with electrically wired learning 
carrels* Alpha boasted that its program could be implemented without modify- 
ing classrooms , butj in 1971^72| one classroom was cArpeted and eontalned car-- 
rels* Weitinghouse and CO/MES begarf with carpeting and air conditioning* 



Each contractor created a motivational component ^thin its system, 
and Westinghouse derived their inspiration from the work of Lloyd Utmmm^ who 
is credited with converting psychologist B, F* Skinner -s theories of behavior 
reinforcement for institutional use. Their eystems emphasized positive rein- 
forcement through ■'contingency management." That is, they molded the class'* 
room envirorment to reward acceptable behaviors. Examples follows 
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Alpha instituted a '*token economy" in which students were rewarded 
for good behavior and academic performance. Each day students had 
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time to spend their takens in a "RE Room" (for "reinforcing events") 
filled with childhood delights— games , toys, candy, pinball, music, 
billiards. 



Westlnghouse provided "buzz breaks" In an "activity room." Comple- 
tion of three lessons of academic work entitled a student to two 
buzzes (an alarm elot.k buzzed every five oiinutea) Ir 'he activity 
room. In addition, Westlnghouse instituted a point system. Dili- 
gence and good behavior resulted in points negotiable for hamburg- 
ers, small toySj etc. 

CO/MES had a free area where a student who finished a day's work 
could relax, play a game or listen, to tnusic. It also emphasized 
"achievement motivation sBsslons" in which teacher and students met 
weekly In small, groups to discuss themselves ^ their values and 
their problf 



Changes MaJe for Second Year 

All three companies made substantial changes in their programs before 
the second year began. Each company acquired different learning materials 
and revised the sequence of learning activities. CO/MES began teaching all 
sixth graders— not just underachlevers . As a result, achievement motivation 
sessions were deemed unnecessary for some students and have been left to the 
discretion of the staff. This ability for eastly changing materials and ap- 
proach is cited as one advantage that performance contractors hold over schools 

All three companies use a differentiated staffing pattern. For example 
in the CO/JfflS centers, there is one "director" who Is a professional teacher 
and two "specialists" who are aides. 

Clearly, there is more similarity than difference between the three con- 
tractors- approaches to Instruction. Test results and subjective judgments 
indicate that the three contractors achieved approximately the same gains 
Vruggink euggests that the details of the systems are unimportant, that "what 
xs successful here may not be the system, but merely being systematic " 
While the instructional techniques and "systematic" approach may be necesBary 
for improving student learning, they probably are not sufficient. The si 
contractors with the same methods did less well in other cities 



The administrative atmosphere of the school system In Grand Rapids was 
conducive to these projects. Norman Welnhelmer. superintendent when the con- 
tracts were signed in 1970, has become one of Michigan's leading spokesmen 
for performance contracts and other accountability procedures. Vruggink re- 
cently completed his doctorate with a five=year study of compensatory educa- 
tion. A pragmatic man, willing to try most anything to help kids learn, Vrug- 
gink is especially disillusioned with the results of compensatory education " 
and most anxious to discover alternatives. Joan Webster, the district's "di- 
rector of contract learning,., shares Welnhelmcr-s view that schools should 
be more businesslike in their practices and decision making. Moreover she 
IS reported to be majterful at human relations and a firebrand for innovative 
ER|c * ^""It. she is considered an effective spokesman and facilitator 



One can hear around the nation some hair-raising stories about conflict 
between school representatives and company employes. In Grand Rapids p one 
finds a mutual admiration society* CO/MES hired Clay Coleman, a popular former 
prlneipal of Sputh Middle School, to direct its project there. Alpha's John 
Cline was easygoing and ingratiating, Westinghouse selected Jack Goldberg, a 
trained, sharp and efficient school administrator. "All three are hustlers. 
Our kids have benefited^" Joan Webster observes* 

The friendly competition among the contractors helped smooth many poten=^ 
tially rough moments during the projects. One lesson to be considered from 
Grand Rapids' experience , observers report, is to set contractors competing 
with each other within the same district. This seems to take some of the onus 
off a single contractor whose presence is taken as a challenge to the school 
sys tern . 

Other cities often found their performance contract projects embroiled 
in tensions that wrack those school sys tems"urban blight, conmiunity dissat-' 
isfactionj racial disturbances and financial crises. These problems are not 
so grim in Grand Rapids. Its populace is more apathetlCs its racial minori^ 
ties are less militant, its finances are less critical i 

Unlike Indiana 3 where the state superintendent of public instruction 
fought the performance contract in Gary, Michigan's state superintendent ^ 
John Porter, urges perfotmance Cdntracts. He has become a national figure be-^ 
cause of his emphasis on accountability and performance contracts for schools. 
In this environment, Grand Rapids acquired state funds as well as moral and 
poll tical support , 

Nor did teachers challenge the programs. Despite NEA's strong negative 
stance^ the Michigan Education Assn. and the Grand Rapids Education Assn. (GREA) 
adopted hopeful wait=and=see attitudes toward the projects « "If these companies 
think they have better ways to teach kidSj who were we to stand in the way?" 
David Thompson, GREA executive secretary, asked. Martha Golden, a past 
president of GREAj taught in the Alpha program and became a staunch supporter 
of the program* Somewhat Ironically ^ she left Grand Rapids Co manage Alpha's 
new performance contract in Lansing, Mich. 

In short. Grand Rapids was fertile soil for planting thaae experimental 
projects. The Grand Rapids school system, following a policy similar to the 
one adopted by Gary, dlsmlased the complex approach to performance contracts 
advocated by Lessinger and Blaschke, Grand Rapids chafed all year at the nu-^ 
merous constraints Imposed by the OEO contract with Alpha i They wrote simple 
documents the second year, Vruggink is pleased with the straightforward con= 
tracts negotiated in Grand Rapids. He prefers the flexibility offered both 
the district and 'contractor , There are too many unknowns in such projects 
to try to pin down every detail in advance, he believes. 

The Grand Rapids contracta include no outside evaluators or auditors. 

So far* no one has challenged the legality of these contracts and there 
have been no snags between the school system and the companies* However, many 
of the legal issues raised in Gary could be raised in Grand Rapids | they sim- 
ply have not been. 
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iXCEPTIONS TO THE CONTRACT STEREOTYPE 



h y*"^ °^ performance contracts, particularly because 

both the popular and the education press devoted so much space to Texarkana 
Banneker and the OEO experiment, a stereotype of performance contracting emerged 

• Disadvantaged youngsters, usually in citlea. 

• Private corporations contracting with school districts. 

• Instruction in reading and aaathematics . 

• Payment based on a single test score. 

This stereotype, which some dubbed the ••Texarkana model" or the "Lessinger- 
Blaschke model of performance contracting, was widely Imitated and discussed- 
It accurately characterizes as many as 901 of all performance contracts. 

However, since a performance contract Is merely a means for purchasina 
education, none of these characteristics is a necessary condition of perfor- 
mance contracts . Contracts could include any kind of student, whether young 
or old, advantaged or disadvantaged, excellent student or underachlever . Any- 
one willing to share the financial risk of education could be a party to a 
performance contract, such as teachers or teachers unions, nonprofit corpora^ 
tions and foundations, universities and professors, government agencies or 
civic groups. Instruction could be in any subject matter. Payment could be 
baaed on any mutually acceptable measura or set of measures. 

/^Ithough they were granted little publicity, several performance con- 
tracts have broken away from the stereotype. More are likely. 

Seeking Broader Horizons 

One example is Cherry Creek, Colo., a wealthy, white suburban district 
outside Denver. Compared to most school districts, it has few disadvantaged 
children. Yet, when the state of Colorado decided, on very short notice in 
August 1970 to seek three school systems for an experiment with performance 
contracts, Cherry Creek volunteered. Except for the student population the 
project fulfilled the Texarkana stereotype-even to the contractor, Dorsett 
Educational Systems. But while the state had intended to experiment with 
disadvantaged children, it could not find them in Cherry Creek. Although the 
state- had stipulated that the 100 children in the project had to be two grade 
levels below norm in reading, 100 such children could not be found. So the 
contract was rewritten to include children only one year below norm. (For 
details, see p. 47.) Most Cherry Creek students completed Instructional units 
cwicj as rapidly as had students in Texarkana. 
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other examplea of performance contracts in which thm district did not 
concentrate on the disadvantaged include: 



Bo a ton ; Educational Sclutlona, Inc., a New York corporation that dls^ 
tributes the Worda in Color reading materials, was awarded a contract in 
1970-71 to Improve reading of students in a public school, no matter what 
their reading ability. 

Gary s At the Banneker School, the entire school was included, although 
at least 25% of that school's population was regarded as "at or above norms" 
when the program began* 

Grand Rapids * In the second year of most of the projects in Grand Rapids ^ 
entire grade levels in a school (e.g., all sixth graders) were included in 
learning center activity * whereas in the first year students had been chosen 
on the basis of academic deficiency* Parents had urged that the programs be 
expanded to include all students, 

Taachers Try Contracts, Too 

During the second semester of 1969-70, ^ile Taxark^na was still receiv- 
ing press coverage for having the nation's only performance contract ^ Port- 
land, Ore* 5 signed one contract with a team of five teachers using Title I 
funds , 

One elementary school had hired a local equipment vendor In a perfor^ 
mance contract ^ on the basis of extra pay for substantially greater student 
gains in readings The five teachers ^ in a different elementary school, re- 
quested and received a similar arrangement, James Holmes, director of plan^ 
ning and evaluation for the Portland Public Schools, eKplained that "the idea 
was to allow teachers or educational equipment vendors to demonstrate new pro- 
cedures and to accept some degree of financial responsibility for the outcome J' 

During the surmer of 1970, a threa-way contract was signed involving 
the district and the teachers, who then were allowed to subcontract with 
Open Court Publishing Co* At the end of the contract , students' measured 
gains in reading were 28% above the gains eKpeuted under previous atandarda. 
However, they fell considerably below the optimistic gains anticipated by 
Open Courts Thus, Open Court became the first of several corporations to 
lose money because they overestimated the amount youngsters would learn. 

Also that simmers two double-or^nothing contracts using Title I funds 
for remedial reading were signed in Portland^'-one with a private corporation 
(for equipment and materials) and one with a teacher. If the students de"- 
monstrated gains twice what would be expected, the contractor would receive 
twice the normal payment | otherwise, nothing. Holmes reports that the students 
did achieve twice their expected gainj and the teacher received double payment. 

Teachers In Keokuk, Iowa, imitated the Texarkana experience on their own 
terms* Teachers, aides and students were given incentive contracts— the more 
each student learned, the more incantlves he would receive and the more teach^ 
era and aides would be paid. The results reportedly please nearly everyone^ 
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"The averaga gain for the 60 students was seven months the 
English Journal reported In January 1971.,.. "The results of a ques» 
tionnaire administered to the students revealed that 27 studenta 
felt they had made progress in reading; 27 indicated some prog- 
ress***. Students also indicated they liked the incentive concept | 
44 favored it while seven said it made no difference,,.." 

This, incidentally j is one of very few contracts \^ere anyone reported 
any data on student attitude. 

Cherry Creekp Colo,, has had several projects in which teachers contracted 
with the district for a bonus if students assigned to them in special programs 
achieved major gains. Cherry Creek also has planned projects in which a school 
principal contracts with the district, followed by a contract between the prln= 
clpal and teams of teachers In his building. 

In Dade County, Fla., four contracts were launched in January 1972, Each 
of the contracts required the contractor to exceed the normal expectations for 
the students involved* Two contracts were with private corporations-^BRL and 
Plan Education Centers, One contract involves three teanhers| the other con- 
tract Involves four teachers and two principals* 



Contracts with the Stats, Parants, Students 

To date, performance contracts have only been signed with private corpo- 
rations and with teachers and their organizations* However, others are being 
dlscuased. Some states are thinking about performance contracts between 
school districts and state departments of education in which a district's 
share of state aid would be dependent on that district -s performance* Michi- 
gan distributea state compensatory education funds on this basis ^ in a three- 
year experiment which began in 1971=72, 

Also, it has been suggested that contracts for learning achievement be 
made directly between school districts and students. USOE sponsored a four- 
city study in 1971--72 in ^Ich incentives were paid to teachers in two cities, 
and to parents and teachers in two other cities. 
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More Than Just Reading and Math 

For many reasons, almost every contract has been for reading Instruction | 
many have been for reading and mathematics. These subjects are the popular 
measure of school success and failure; instructional materials are most plenti- 
ful j and publishers taiow enough about the materials to consider guaranteeing 
results. The national Right To Read project, the availability of coimionly 
accepted standardized tests and the Influence of the publicity of Texarkana, 
et al,, have led moat contracts along this path. 

Again, thera are exceptions. The Banneker project involved the entire 
currlculimp although the program stressed reading and mathematics achievement. 
So did the contract in Duval County, Fla., although that contract was designed 
primarily as a performance contract for teacher training. 
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Dallas, Tex*, had a contract for vocational education with the Clearfield 
Division of Thiokql Chemical Co. Firsts Dallas selected a group of under-- 
achieving high school students who, they believed^ were susceptible to dropping 
out. Between their selection in the spring and the beginning of the program 
the next fall, half did drop out. Of those remaining, 960 were "experimental" 
and the remaining 700 were "control,** 

Donald Waldrlpj Dallas' assistant superintendent for accountability and 
personnel development describes the group as being well below the national 
50th percentile in reading, vocabulary and mathematics skills* "Their teach- 
ers and counselors indicated that each seemed to lack any desire to succeed 
in schools or any realistic goals in life,,.. We chose to go after the tough= 
est customers.*' 

A year before actual teaching started, planning began with a citywlde 
group of 30 people that included parents, businessmen^ civic leaders and 
teachers. One highlight of this group's effort was the inclusion of a course 
In drafting for girls , all of whom were accepted by local industry when they 
graduated. The planning group prepared a "wish-list'' which was refined into 
a "request for proposals" and sent to 31 potential bidders. 

Eventually, New Century, a division of the Meredith Corp,, received the 
contract for the portion of the program labeled "coiranunicatlons and mathe= 
naaticB," and Thiokol Chemical Co* received the Gontract for "achievement 
motivation and occupational training," 

In order to maximize the training of staff from these programs, the Dal- 
las district requested that only Its own teachers be used by the contractors. 
Dallas also insisted that contractors V. programs be compatible with the school 
system's operation so the programs could be adopted , if successful* Thiokol 's 
program was adopted by the district the next year. 

While the emphasis In Dallas was primarily on teaching students, the im- 
plications for teacher training were not lost. Said Waldrip i "I venture the 
opinion that performance contracting poses no threat to any school district -s 
teachers t Biit it does pose a threat to teaeher^trainlng institutiona . If 
Thiokol or New Century or Jim--Dandy Educational Systems can teach teachers to 
teach potential dropout s to read, after all the tenured PhiD*'s In our univer- 
sities have so resoundingly failed—then I predict we will see a lot of Ph,D.-s 
out of work during the next decade." 

In Dwal County's contract with Learning Research Associates CLRA) , the 
major emphasis was on teacher training. The school district decided that 
teachers should be trained in the use of "inquiry" or "scientific heuristic" 
methods of instruction. Moreover , the school district selected the teaching 
materials to be used* 

The contractor was termed "teacher support contractor," The program be-- 
gan in the winter of 1970=71 and ran until Junei' It was rs'-funded for 1971^72. 

In the firet phase, only first-grade teachers participated. They re- 
ceived three weeks' training in theoretical and practical problems, including 
demonstrations with pupils and academic study. Stress was placed on teachers* 
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self=awareness as it affects the new teaching role of supporting atudent in- 
quiry. The contractor continued to train and assist teachers throushout the 
program. 

In the second year, the trained first-grade teachers became second-grade 
teachers under the guidance of the contractor. They, in turn, aided a new 
group of first-grade teachers. 



Other Ways To Establish the Payoff 

As in Texarkana and Gary's Banneker project, most contracts merely re- 
quire that students be pretested and poattested, with payment to the con= 
tractor contingent on an Increase in test scores. 

Both Dallas and Duval County used the practice of having an outside 
evaluator and an external auditor similar to those pioneered in Texarkana 
but both moved beyond the simplistic and troublesome use of a sinole test' 
(See section on Testing, p. 49.) o ■ 

Dallas did retain Che standardized test score for measuring reading and 
mathematies gainj the contractor would be unable to recoup his costs if stu- 
dents did not gain an average of 1.4 grade-levels in one scholastic year in 
contrast to the typical 0.5 grade-level gain for similar students. New Cen- 
tury did poorly by this standard, gaining an average .53 while the control 
group gained an average .48. In mathematics, the students gain .33 of a grade 
level while the control group lost .09 grade. In addition, for information's 
sake, criterion-referenced tests were administered. These, to everyone's 
consternation, showed almost no correlation with the standardized scores 




Dallas used school attendance to measure gains in achievement motivation - 
The contractor was also required to reduce dropout rates below those of USOE's 
five most successful Title VIII projects. Attendance was measured not in the 
elassls°^"^ motivation sessions themselves but in the reading and mathematics 

^ Dallas measured occupational training by Judging whether the graduates of 
the program were employable, as Judged by a panel of potential employers 
Using these measures, achievement motivation classes were successful. Stu- 
dents attended "communications" and mathematics classes 86% of the time, com- 
pared to 73/ m the regular program the year before. In addition, students 
assigned to achievement motivation classes scored better on reading and mathe- 
matics tests than those who were not assigned. Ninety- one per cent of achieve- 
ment motivation students remained in school the entire year, although Initially 
identified as potential dropouts. ■ 

^ Vocational training figures ware also impressive i 26.7% of all students 
m the Chree vocational courses-auto mechanics, machine metals and drafting-- 
reached the graduate level of training and were employed- 13. 3Z reached the 
apprenticeship laveli 21.3% achieved the level of assistant; and 23.3% reached 
the helper level. That is, 84.4% of students enrolled achieved exit levels 
of employabillty. If one includes only those who attended at least 84% of 
the time, as was etipulatad in Thiokol's contract, 95% reached employabillty. 
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In Duval County ^ this complex scheme was used to pay the contractor: 



• 50% based on performance of students on the Stanford Achievement 
Test: Primary 1 Battery, as compared with a random sample of other 
Title I students. That is ^ if the average for the students in the 
program did not exceed the average of other Title I students in 
Duval County, the contractor would lose 50% of his payment* 

• 25% based on criterion^ref erenced items covering the curriculimi in 
readings math J social studies and science. Tests in 100 objectives j 
25 in each areaj are given three times during the program* The 
tests were constructed by the outside evaluation contractor* Pay^ 
ment to the teacher^support contractor is sealed from no payment 

at 40% achievement to total payment at 100 %s 

• 20% based on student achievement above expectation. This was fur- 
ther broken down; 

8% based on reading gains above expectation (i.e., 0*5). 

8% based on math gains above eKpectation. 

4% based on scores from "Part The Environment: 

Social Studies and Science" of the Stanford Early 

School Achievement Test" Level II, 

• 5% based on gains in IQ scores as measured by the Kuhlmann-Anderson 
test. 

Of course 5 the presimptlon behind all this testing is the assertion that 
better trained teachers will cause improved tested achool performance by stu-^ 
dents* This seemed to be borne out by the results of the first phase. 

The contractDr received the 50% payment for total gains, over gains 
shown by a random smiple of Title I students. The contractor also received 
about 66% of the amount possible on the crlterion=ref erenced tests, 40% of 
the money on gains above expectations and 33% of the money possible from IQ 
score gain. 

LRA actually received over $50,000 of the nearly $70 ^ 000 possible under 
the performance contract | in addition^ LRA received $9,000 for students who 
withdrew or otherwise did not fall under thfe performance contract. The proj-' 
ect was continued and eKpanded for another year* 

The examples of Dallas and Duval County auggest that measures of success 
in performance contracting can range far beyond simple pretest/pos ttest de- 
signs * Measures might include a mixture of scores from several tests, or 
multiple interpretations of a single test| measures of competence such as 
critarion=ref erenced tests, or employabill tyi and measures of student behav= 
ior such as increased attendance ^ reduction of vandalism, or imprdved records 
of student deportment might be added* 

EKpert judgment might supplement or replace tests* Gary and Duval County 
both surveyed parents of students Involved in the performance contract* 
Although not used for payment to the contractor in those sites, such surveys 
^ i^ght prove eKcellent measures of a program-s success . 
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I-Team, in which the "I" stands for "interdisciplinary," is a dropout 
prevention progrM for Cherry Creek high school juniors and seniors. They 
are identified by the teachers, counselors or administrators who volunteer 
for this special program. 

Housed in a building some miles from the high school, the program is 
educationally distant as well. It is relaxed, informal, Intensely personal, 
as much s counseling, supportive, student-centered prograin as an academic one. 

The staff consisted In 1970-71 of three full-time teachers, two teaching 
interns from naarby universities, one director and a secretary. The three 
full-time teachers were on a performance contract which promised a bonus if 
the project's many objectives were satigfactorily completed. 

A portion of a student day is academic, but the curriculum has been 
divided into "minicourses" tailored to student Interests. A student's self- 
selected program may mirror a traditional program, if he chooses, or it may 
not. Other time is free for lounging and relaxing, for counseling and small 
group discussions, for work-experience, cammunity projects and special interests. 

Although disguised as dropout prevention™which it does admirably— I- 
Team is an "alternative" school within the district, in which a systematic 
attempt at diagnosis, prescription, assessment and evaluation of each student 
IS tempered with large doses of friendship and support. The final evaluation 
of thf program in 1971, conducted, by a team of college professors, was enthu- 
siastic in Its description and assessment of I-Team's progress; 

The total outcome has been that of a greatly Improved instructional 
situation for educationally handicapped secondary students. In the 
original proposal the statement was made? "Our work begins with 
the student. In the 'I' Program, tiie student comes first! This Is 

our reason for being Everything in the operation of the program 

must be focused with this in minds the student comes first. We 
may experiment because we do not always know what the student 
needs.,.. We hope to discover what will help and what will work, 
and we will always focus our thoughts on this primary premise: The 
Student Comes First!" It Is the belief of this evaluator that both 
.the director and the staff have not spared themselves in attempting 
to attain this rather lofty goal. 

The program had nine specific objectives, measured in several ways In 
the judgment of the evaluators , the program achieved all nine to a high degree. 

9 A model was to be developed for "interdisciplinary, student-centered 
experiences for adueationally hariicapped secondary students." This 
was judged successful because such a document was submitted. 

• For this program, "teacher-developed methods and materials" will be cre- 
ated. The evaluators discussed this objective with teachers | observed 
materials that had been created for instruction, testing and record 
keeping; and concluded the objective had been met. 

47 



• Teaching materials would emphaslEe ''applications of conceptual knowledge 
rather than abstract facts . " Here the evaluators examined the teaching 
niaterials as well as analyzing teacher and student reports of the program, 

• An environment would be created for "successful educational eKperiences 
which provide the opportunity for increased achievement levels*" This 
was measured both in terms of the ratio of successes to failures—there 
were almost no failures—and in terms of gains on achievement tests. 
Gains averaged approKimately 2*0 years in reading and 3,3 years in math, 

• The environment would prDvide "educational experiences leading to suc^ 
cessful adjustments to the school situation through program modifications 
emphasizing the relatedness of their educational program to their lives 
and needs," Teacher reports, student reports ^ reduction of vandalism to 
zero j increased attendance and evidence from a Semantic Differential 
Test all attest to success with this objective, 

• The environment will produce "attitudinal changes toward school and edu-- 
cation J* This was evaluated through student and teacher self-reports, 

• Students would become more involved in development of the Instructional 
situations in which they learn| that is, there would grow a student^ 
centered approach to learning. Student and teacher reports both indi^ 
cate that this occurred; was welcomed by students; and should increase 
in future years ^ in students' opinion, 

• Students will develop social awareness* Some evidence was found in stu= 
f'^^nt reports, in projects completed, and in changes in student courtesy, 
respect and concern for other students* Evaluators suggested this was 
the least well achieved objective, 

• Students will become involved In the "real world of work," Virtually 
every student held a job, often with deep satisfaction and success. 



Finally J in the opinion of the evaluators , the bonus feature for staff 
mambers was effective and should be broadened to the entire project staffs 

The Cherry Creek School District has justified the premise that "per-- 
formance contracting" does, have a place—the place is within the 
school district, by the district standards and objectives and by 
the district personnel*... This feature which provides incentive 
pay to teachers within the district (not to commercial educationaT 
entrepreneurs) would, seem to have merit. Each of the Involved staff 
members noted some concern relative to his effectiveness in achiev^ 
ing his bonus* No ill effects have been noted so far. This recom-- 
mendation is for increasing the number of staff members who might 
receive such a bonus, specifically, the two interns, the secretary 
and the director. 

The eKperiences with performance contracting in Cherry Creekj Buval Coun^ 
ty, Dade County, Dallas , Boston, Keokuk ^ Portland , Stockton, Mesa and a few 
other places collectively suggest that performance contracts may well be used 
^ In many kinds of school settings 5 for many purpoaes and with many variations* 
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TESTING— A POTENTIAL BOOBY TRAP 

Inseparable from discussions about performance contractina— as it has 
been practiced to date^^are questions about testing. In the fall of 197? 
Tho«as Hogan Of tha U. of Wisconsin remarked that many of !a uses of ' 
tests m performance contracts have been "sheer nonsense," and that 
tiona regarding questionable practices will frequently be true." 



E. Gary Joselyn of the U. of Minnesota claimed in January 1971 that 

1971 JssSl%fphfDeit''f "TJ'' P^^f°-«nce Contracting," in the June 
Tiit, Phi Delta Kappan, Robert Stake not only detailed the problems of 

iJmf aroS" Performance contracting but analysed why tKS prob° 

Srreit^fJ*"™^" contracting appears to be popular with the 
current Adniinistration m Washington because it encourages private 
businesses to participate in a traditionally public responsibility. 
It IS popular among some school administrators because it affords 
new access to federal funds, because it is a way to get new talent 
working on old problen>s and because the adminisLatof can aasily 
blame the outside agency and the government if the contract instruc- 
tion IS unsuccessful. It is unpopular with the AFT because it re- 
duces the control the union has over school operations, and it re= 
need^ost. ' ' what learning 'students 

Performance contracting is popular amona most instructional technol- 
ogists because is based on well researched principles of teaching 
eoiJ'hn'f " operations. The ac! 

urrof .'u'h^ " " IS. likely to be a success or fail= 

ure on such sociopolitical items. 

Second, to the person little acquainted with educational test- 
are'for ^^^^l '^^^ Performance testing is what educational tests 
InLrpretaMon ofl^' ^P^^^li" knows better.... The common-sense 
interpretation of these results is frequently wrong. 

t.on .o.e .doctors, parents or s.Kool bo.rd LZt. iTZT.llZl tr^^l,. 

ERIC 49 



'Being Systematic— A Kay to Suecesi 

Elmer Vruggink, assistant superintendent in Grand Rapids * recognised ^ 
that the lesson to be learned from the three performance contractors in his 
city was ^'not the system, but being systematic." Educators, says Vruggink, 
have rarely been systematic. What does it mean to be '-systematic?" . 

Scarcely hidden beneath the surface of both "accountability and^_'-per-^ 
mance contracting" is the notion of "systems*' or "systems approaches." This 
is not a clearcut nQtion, any more than "accountability" is; but the two ideas 
are very similar and often are espoused by the same people. 

In effect^ a ays tern is any goal-oriented enterprise. It is character- 
ised by procedures for defining goals ^ organization to accomplish these 
goals, collection of data on the ef f activeness of the system, and procedures 
for perfecting the process as experience (that is, the data) suggests. 

Systems comu in all sizes, as big as the systematic attempt to land 
men on the moon, as small as mechanically threading a needle. Systems^ account^ 
ability^ technology, management — these are all intertwined concepts. Indeed, 
the use of documents called "performance contracts" was previously part of a 
"procurement system" used by the military. 

Two related features of any systematic approauii are goal setting and 
evaluation. How close did we come to reaching the goals? I^ere did we fall 
short? Wliy? Depending upon the "system" to be evaluated, available methods 
of evaluation are numerous; some methods use tests, some methods do not. 

But when evaluators employ testing, they often do not use tests in 
the way public schools generally use tests, namely, to judge or rank students. 
Their fundamental emphasis for evaluation is to judge systems, not students, 

"Without knowledge of results ^ a system Is blind and doomed," wrote Leon 
Lessinger, in the November 1971 issue of National Elementary Principal , Yet 
"school systems have very limited and primitive feedback sys tarns * It is the 
rare teacher who uses evaluation to change his approaches to instruction. Few 
schools compare their performance to their objectives," Lessinger said* 



The Product: An Initructlonal System 

"Until the recent development of educational systems companies such as 
BBL^ there have been few ways to give the concept of accountability real mean^ 
Ing in the public schools," wrote BRL in its proposal to Gary, Ind, , in 1970, 
BRL and most other companies wlth^ an Interest in performance contracts are 
"systems" companies. Their products are "instructional systems." Blaschke 
refers to these companies as *'sys terns management companies . " 

The baaic question being asked, at a performance contract site, is this i 
"How good is this system at solving the problem?" As Waldrlp said of his con^ 
tracts in Dallas i "We were not really evaluating performance contracting. 
Rather 5 we were evaluating certain instructional systems, and some of them 
Q will always work better than others." 
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As Robert Stake makes clear, evaluation has tremendous political Impli- 
cations This IS doubly so in perfomance contracts whare tL payment to the 
contractor is directly based on tests. 

For many reasons, the most politically favored and widely used evaluation 
devices m American education are standardized, nom-referancL achievement 
tests m reading and matheinatics . One reason is that they produce "erade- 

Soroi'^atlt'd takes the test' a almple lanJpula- 
tion of that student's score yields a -grade equivalent," specified to one- 
tenth of a grade. Hence, Johnny is said to be at "grade level" 4 8 I- 
Johnny is in the third grade, one presumes 4.8 is good; if Johnny'is in\he 
seventh grade, that's terrible. Moreover since Johnny spends one year in 
school each calendar year, one should expect he will gain "a year for a vear " 
By this reasoning. Johnny should score 5,1 at the beginning of the fifth 
grade, and 6.1 at the beginning of the sixth grade. 

Once one accepts the procedure of considering these "grade=equivalent" 
scorea as a standard for each student's proper grade placeLnt in schoolL^ 
which many laymen, school board members and teachers do-=the apparent but 
misleading statistical manipulations are many. For example, if Johnny is in 
his fifth year of school and tests 2.5, then one "eKpects" Johnny will gai^ 
0.5 years m a year. If he In fact gains 1.5, he has tripled his growtfrate. 

Henry Dyer of ETS has labeled these scores educational and "statistical 
monstrosities." But no matter, they are politically" acceptable , anf so they 
became the measure of performance contract success L all but a few contracL 
Contractors profit or lose money depending upon the number of students who 
achieve specified "grade gains." -oent^ wno 

The trouble is, the tests are not designed to be used that way Thev 
provide, at the vary best, a guide for discriminating among atudants. nofa 
precise measure of each student. Scores are subject to too many influencaJ 
and internal errors beyond how much students leaJn^-student ^JLud" m^tura- 
tion. experience with tests, test=admlnistration conditions, test selection 

Sta'aboot' 'f""; '^"^^ '^^"^ yield valuable predictive 

data about groups of students, many educators prefer to use them to judge st u- 

cordefof s?'f ^'^^r^^^^^ set reported in newspapers and re! 

corded on student records and are used to justify claims for success or failure 
of school systems, federal projects, legislative appropriations dften s^u^ 
Jnf ^t'f f "P"' °^ tracked on the basis of gradellqulvalent scorS' l^clud- 
mg students assigned to most performance contracted learning experiments 

^ A anxious to demonstrate their wares, have agreed to be 

judged by these tests, although they understand better than fheir cLants 
how^statistically precarious the results of these tests can be. "We didn'^ 
pick the test," they insist; "the school picked the tests." didn . 

If one looks at a list of grade-equivalent gain scores from various per- 

vel^a'^'a 'th'"""* ^^""^ ^^^^ average gain, of iT 

years another a range from .4 to 2.8 years, another disappointing scores of 
only .33 yaare. What doas this mean? About as ^eh as if thetnfy measura 
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of thf .wor-trr uf automobiles were the size of the tires. Necessary informa^ 
tioxfis lacking. Which tests were used, which forms of the testp how the _ 
test wa8 administered, what the student population was like, how long between 
pretest and posttest. Most important, does the test measure what the con-^ 
tractor ^.aught or what the students learned? 

Taaehing to the Teat 

Only a small number of correct answers are required to achieve a grade 
gain — in many cases less than five. The temptation is great to coach stu- 
dents to do well on the test. At least two contractors have been caught in 
this bind; Items on the final test were discovered In the instructional ma^ 
terials assigned to students shortly before the teet. However, to return to 
the automobile tire example, if cars with larger tires were worth more money, 
the temptation would be to overinflate the tlrea^-^a dishonest use of a ques- 
tioniible standard. The moral dlleimnas of using standardized testing are 
knotty. 

Another kind of tests brought to some popularity by performance con^ 
tractingj is the criterion-referenced test, Thesa make greater "systematic" 
sense than standardized tests; if there are objectives which the contractor 
is trying to reach ^ test for those objectives. If the "criterion" (objective) 
la that a student shall be able to discriminate between the terms "ratj" 
"rate,** '*art" and "ate 5" test him on that. If the criterion is the ability 
to use a lathe, test him on that* Such testa may be ad hoc or meticulously 
created, and vary greatly In reliability and validity. In general , these 
are not published CQmmerclally and must be created for a specific test situ-^ 
atlon; a few publisherB have begun toying with the Ideai Soma few contracts 
have attempted to mix standardized and criterion-referenced tests. 

Why Testing? 

Are the test scores yielded by performance contracts good evaluation? 
That is how accurate, how valid^ how informative, and how reliable is the data 
from these tests when one wishes to know how successfully the system taught? 

Of course s the answer depends on the objectives. If —and this was true 
in some performance eontracts^ — ^the real objective was to raise test scores 
of kids who don^t test wellp test scores are great (if they are low in the 
fall, hlrgh in the spring—regardless of the reason). Michigan spent $23 mil- 
lion in' 1971=72 to buy grade-equivalent score gains from its lowest achieving 
students. 

But if one's objective is to know whether students read better ^ it is 
probably as reliable to ask students as it is to give standardized tests and 
then manipulate individual students* gain scores. Evaluation (how well did 
the contractor's system teach the students) does not require this kind of use 
of tests* 

The editors wish to thank Roger Lennon of Harcourt, Brace, Javanovich 
and The Psychological Corp* for his advice on this chapter. 
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For further information on the testing issue, the followinc -r tides 
should be helpful: 

Stake, Robert E. "Testing Hazards in Performance Contracting," Phi Delta 
Kappan , June 1971, — — _ — 

197"' ^^^^^ ^' for Accountability," Nation's Schools . December 

Stokes, Charles W. "Measuring Gains with Standardized Teats, or. Flies 
in the Performance Contract Ointment," National Society for Programmed 
Instruction journal . June 1971. 

Dyer, Henry S. "The Role of Evaluation in Accountability," Prot^odings 
of the Conference on E ducational Aeeountabillt y, Educational Testir^I^ 
Service, June 1971, ' ~" 

Joselyn, E. Gary. "Parformance Contracting^ What It's All About," 
presented at the Truth and Soul in Teaching Conference of the American 
Federation of Teachers, Chicago, January 1971, 

Hogan, Thomas P. "Reading Testa and Performance Contracting," presented 
at Indiana Reading Association conference, Bloomington, Ind., November 
1971i 

Lennon, Roger T. "Accountability and Performance Contracting/^ Journ al 
of Resaarch and Development In Education . Fall 1971. ^ 

Ebelj Robert L. "Criterion-Ref ereneed Meaauretnents i Limitations," 
School Review t February 1971, " 

Block, Jatnes H, "Criterlon^Ref erenced Measurements: Potential," School 
Review , February 1971, ' "~" 
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HOW TO INTER A PERFORMANCE CONTRACT 



Entering a performance contract—like hirlrig a teacher, building a build- 
ing or choosing a wife™is easy; or it-s iiranensel/ complax and worrisome , as 
you choose* The simplest way is to contact an educatione 1 company ^ request 
the terms under which that company will performance contract, agree to Chose 
terms and sign on the dotted line. The most complex procedures require system^ 
atically tailoring every decision: Do we need a contract? With whom shall 
we contract? For how long? On what terms? How shall we monitor the contract? 
What shall be done when the contract ends? 

Remembers performance contracting is a new procedure; It invites and 
benefits from ingenuity. There may be good sense in rigorously pursuing the 
procedures suggested in this chapter—unless you find good reasons for doing 
otherwise, ''Caveat einptor!" applies* 

Two thorough efforts to advise school districts about the process of 
performance contracting appeared during 1971 1 An Introduction to Guaranteed 
Performance Contracting ^ from the Michigan State Dept, of Educationi and A 
Guide to Pgrformance Contracting ^ produced under direction of John Adams 
of the Minnesota Dept. of Education for the Interstate Project for State 
Planning and Program Consolidation (available from the Wisconsin State Dept, 
of Public Instruction) , The bulk of this chapter is selected from these sources 

The following steps are suggested as important considerations prior to 
the selection of contracting as the appropriate means for curriculum renewal 
(condensed from Michigan's Guide to Guaranteed Performance Qpnt^actjjig ) i 

Needs Assessinent 

First 5 the process of determining the feasibility for performance con^ 
tracting requires a careful scrutiny of the eKlsting instructional program, 
particularly In terms of pupil outputs. Questions should be posed and an-- 
swered quantitatively about pupil achievement in various subjects and at all 
grade levels* Student performance in high school should be researched and 
data reflecting dropouts ^ vocational placement and college success should be 
gathered. Of particular interest and value would be comparative data derived 
from standardised achievement instruments. 

Specif Ically J those children who are not doing well in school ought to 
be identified. Their strengths and weaknesses should be charted graphically 
so that a profile of the district's instructional "boK score" can be clearly 
visualized. 
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The needs assessment ought to involve participation by the In^al district' 
professional staff, the conimunity and possibly outside sources. chool- 
community ad hoc council might be formed to appraise the study and provide 
advisory service to the local board of education. The school and community 
could cooperatively establish prloritiea of InBtructional needs and decide 
together how best to cope with them. 



Appraisal of Local Resources 

Another study, that of local resources, ghould be undertaken to deter- 
mine whether the district can resolve its own recognized needs. This appraisal 
ought to be thorough and objectivti- and it should include at least the fol- 
lowing contributions I local staff capability for delivery, resources for 
inservice training, mflnagerial efficiency in curriculum control, and cost 
iSffectiveness facto|is relative to raising pupil achievement. 

Can the district Itself produce the same gains as an independent contractor? 
Can the sctiool district, employing its own Internal resources, applv a ayq terns 
approach to instruction and obtain significant results at the same or lefis 
cost per pupil than an outside contractor could? 



Selecting a Project Director 

For the point in time that a performance contract appears to be a logical 
vehicle for resolving Instructional needs, it is most important that a local 
project director be assigned. The position of project director may or may 
not be a full-time position, depending on the size of the project and the 
assigned responsibility. The superintendent of schools usually cannot devote 
the amount of time and attention necessary to coordinate all of the planning 
phases and negotiations which will require the concentrated efforts of one 
key professional. 

Management Support 

A district, when choosing to enter a performance contract, must recognize 
that added responsibility will be placed on the administrative staff while 
both negotiating and impleinenting the contract. The district should determine 
whether its present administrative staff has the time and expertise to handle 
such responsibility. If not, the district may choose to hire addltlonar admin-^ 
istrative assistance or it may contract with an outside management support 
group. The state department of education can also be of limited assistance. 

When a local school district decides to secure management support it 
should also plan to allot a portion of the proposed budget for such services 
Some management groups may be engaged for a small percentage of the perfor- 
mance contract. Another alternative, one appropriate for a small contract- 
would be for the district to employ management support on a per diem basis 
the number of days dependlnf on its needs and resources. Generally, manase- 
ment support nay perform some or all of the following functions; needs as- 
sessment, assistance to school administrators in developing perfortnance ob- 
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jactives, developing Che request for proposals and bidders list, and the 
assessment of bids received. Unce the program becomes operational, the nian= 
agement support group usually assists the project director with such respon^ 
sibilities as record keeping, monitoring^ determining cost ef f ectiveness , 
public relations and other factors relevant to contract management. The 
management support group may also provide the necessary assistance to imple- 
ment the takeover of the contract by the district (turnkey), 

Devaloping Time Line' or 'Critical Path' 

Once the decision has been made to enter into a contract for instruc" 
tional services^ a time line should be projected* This is a necessary first 
step if all of the phases are to be accomplished without unrealistic deadlines 
and subsequent haste. Serious omissions might be made if the time schedule 
is not designed to appropriately accomodate the tasks or if the proper intsr^ 
vals are not respected. The first date on a time line should be the final 
one — ^the turnkey. Working backward from that datej the school officials might 
then venture some specific predictions^ WTiile each time line will differ 
according to local cohditlonSj the following hypothetical illustration is 
a suggested planning matrix: 



Dec. 1, 1972 


Appoint local project director 


Jan. 1, 1973 


Develop school^community council 


Feb. 1, 1973 


Complete needs study 


Feb, 15, 1973 


Determine goals 


March 15, 1973 


Complete performance objectives 


May 1, 1973 


Complete request for proposals 


June 15, 1973 


Assess bids and select contractor 


Sept. 10, 1973 


Project begins 


Late Sept, or 




uut* 


Pretest 


Nov. 1, 1973 


Interim evaluation 


Feb. 1, 1974 


Interim evaluation 


April 1, 1974 


Interim evaluation 


June 1, 1974 


final evaluation 


Nov, 1, 1974 


Post evaluation 


Sept. 1, 1975 


Turnkey=-Dls trict implements program and continues 



evaluation of pupil gains 



Requests for Proposals (RFP) 

The principal requirement in a request for proposals is an accurate 
narrative description of the educational and related conditions in the dls^ 
trlct* This description may include! educational needs, limitations of 
funding and calendar, the district's resources and the desired objectives* 

Saiaofing a Modal of Parformanoe Contracting 

There are several models of performance contracting. A district should 
investigate the advantages and disadvantages of each^ 
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• Internal I A district should first explore' tha possibilities of effec^ 
tuating a perforniance contract with a group of its own employes. 



• Competitive ^ An RFP should be forwarded to those firms that appear 
to have a system that is consistent with the educational philosophy 
of the school district and potentially capable of meeting the defined 
objectives,. The firms then submit their proposals to the school dis- 
trict. The district evaluates each proposal, selects one* 

• Sole Source * The school selects an educational firm that it believes 
can meet the needs in a certain area, such as reading* As commercial 
firms write more cDntracts and becoine more sophisticated in program 
design, they are developing ready=made plans that are easily adapted 

to the conditions portrayed by the districts when requesting a proposal. 
The company chosen is given the necessary Information concerning the 
target population, time and cost limits and the needs of the population. 
The contractor is then requested to submit a proposal that will meet 
the needs of the children and one which reflects the accepted theory 
of learning for the district, 

• Modified Sole Source - Instead of involving one firm, three to four 
firms are contacted. The companies are invited to a joint conference 
after the school district has had the opportunity to study and evaluate 
their proposals. The contractors are permitted to bid against one 
another. This process affords the school district the opportunity to 
evaluate the opinions and proposals of each of the bidding firms, 

• Comparative s The school district should go through the preliminary 
phases as It would if it chose any one of the four models above. After 
the preliminary work is done, the district selects two contractors 
judged to have equal potential for solving the stated problem, The 
district then divides the children involved in the project area (a) as 
evenly as possible between the two contractors. The use of this model 
places the project in a research setting, enabling the local district 
to study methods and results relative to eventual turnkey decisions. 

Considerations in Selecting a Contractor 

The program and staff capabilities of a contractor are the first con- 
siderations in selecting a contractor. Who are the members of the staff? 
What are their past involvements and experiences? What is the reputation 
or ''character" of the firm? What is its "track record?'* What other projects 
has it been involved in and what were the results? Is its program a mul- 
tiple^ or single^lihear system? There should be alternatives available so 
if a student fails in the method provided by the contractor it can provide 
alternate routes for him to follow to accomplish the objectives. 

The financial capability and status of the contractor should be explained 
The district should consider who is to pay the start-up costs* While there 
may be advantages to the district to pay the start-up costs, it must be real- 
ized that with this "front-end" load the district will assume major financial 
responsibility if the contractor falls to deliver. The ratio of start-up 
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costs to total cost must be considered to avoid a project which is too expen^ 
sive to replicate in the district. It is also a wise idaa for uhe district 
to get a Dunn and Bradstreet rating on the firm. A performance bond may also 
bt required if thera is question as to the ability of the contractor to fi-- 
nance the project. 

An understanding of the motivational system used by the contractor should 
be gained to see if it is consistent with district philosophy* Such questions 
as whether the rewards are intrinsic or extrinsic should be covered^ Do the 
incentives apply to both staff and students? How would the PTA and other 
groups feel about giving students "green stamps" or other rewards for achieve- 
ment? The kinds of management support (such as PPBS) to determine the cost 
ef f actlveness the contractor proposes to use should be spellad out. Is the 
contractor himself on a PPBS operation? Or does he at least have a program 
which appears to be operable? If he intends to write objectives for the pro- 
gram, has his organization written out objectives for their own operation? 

The Way in which the contractor handles his research and development 
(R&D) costd bears close eKamlnation . R&D can be either capitalized or eKpensed. 
if it Is capitalized it is amortlEed over a period of years* If it is expensed 
it is charged to the period in which the costs were Incurred* From the dis^ 
trict's point of view it is praferable to have R&D costs expansed so that the 
district is being charged only for the actual costs involved in their project: 
and is not paying for R&D done on previous projects* If capitalized ^ a 
rationale should be offered explaining how the previous MD coats relate to 
the present project. 

The school district should have a clear understanding of proposed sub^ 
contracting and the necessity for It, If a large portion of the contractor's 
work has to be subcontracted , there may be waste in high consulting fees and 
over-all lack of continuity in the project. 

The potential "economies of scale-* involved In the project must be as- 
sassed. '■Economies of scale'* refers to the forces causing the long-run average 
cost of servicing students to decrease as the contractor (or district) in^ 
creases the number of students. Two important economies of scale are increase 
ing possibilities of division and specialisation of labor, and increasing pos- 
sibilities of using advanced technological development or machines. 

Division and specialisation of labor can be achieved through application 
of differentiated staffing utilizing teacher aides and paraprof essionals . 
Districts should have the contractor reveal his staffing plan in advance so 
that student-teacher ratios ^ adult-student ratios and other factors are accept- 
able to the boards administrators , teachers, parents and other groups * State 
staffing requirements and legislated ratios must also be considered. 

Additional terms coming into the educational vocabulary are ''cynstmables" 
and "non-consiBnables , " These terns obviously refer to the life expectancy 
of items purchased. Roughly , a cons™able item is one whose useful life is 
less than one yearp and a non^eonsinnable Item's useful life Is of greater 
duration than one year. Care should be taken by the district to see that in 
a highly cons mnable system soma guarantee is made that the contractor will 
not increase the price of the items after the turnkey phase, and that there 
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is some assurance that the consimable iteins will remain compatible with the 
hardware over an extended period of time. School districts should also re- 
frain from purchasing non-^consuinable materials from the contractor during 
the first year of the project. If it fails, the district is still committed 
to pay for the materials. A preferred way would be for the district; to lease 
the equlpmant or materials for the first year, and apply the leased costs 
toward the purchase price if the system proves to be successful. 

Of paramount importance, but often overlooked ^ la the involvement of 
the coninunity in the planning stages, A program, offered by a contractor, 
which is unacceptable to th? consimiers has slight chance for success. 
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Writing the Contract 

While every contract differs in content and style, most of them have 
several comion essential elements. Some hastily written contracts have ne-- 
glected contract provisions that would have solved problems that later aro 
School districts are well advised to use the services of an attorney in 
drawing up this legal dociment. Therefore, the following should not be 
interpreted as a complete or model contract but rather should be regarded 
as a smmnary of items commonly found in contracts, or as suggestions of 
items worth including. 

The format of this section is as follows: first, a description of what 
the contract clause contains; second, an illustrative mock-up clause. 

1 . D^ef Initlon of parties i 

This should include specification of the fiscal agents the residency 
requirements j director and manager names, and any subcontractors, 

• Contractor - Educational Learning Services Incorporated, Brownsville 

Independent School District No. 333— the entity awarding this contract, 

• Project Director - Mr. George Allen (or his successor designated by the 

district), to reside in the Brownsville district. 

• Project Manager - Wfcs. Jean Smith (or her successor, designated by the 

contractor), to reside in the district. 
« Management Support Group - Management for Education, Inc., to provide 
the agreed upon number of on-site days, 

• Auditing Contractor = Testing for Reliability, Inc., to provide the agree 

upon number of on--slte days. 

2* The esta blishment and descrlpt .^ oTL Qf_responslblllties within school and 
within contractor I 

a) The district will appoint a project director and management support 
group* The district will appoint a project director to oversee the 
project activities of the contractors. He will be a full-time, paid 
employe of the district. The project director as the authorlEed repre- 
sentative of the district shall have general responsibilities for co= 
ordination and actoinistration of the program with regard to the district, 
the contractor, the management support groups the auditing contractor, 
the local comiunity, project personnel ^ parents and student participants 
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b) The contractor shall appoint the project manager^ subject to the prior 
approval of the project director. The project manager will report di- 
rectly to the project director, 

3, Definition of personnel , including hiring agency, certification require-- 
mentSi provision of paraprofessionals , juriRdiction of local salary scheduleB 
or fringe benefits i 

The contractor shall control its curriculun, teaching aidSj materials , 
and Gonduct of reading and mathematics programs in accordance with the 
conditions of this agreement ^ and shall hire, train and fire its own 
employes, agents or independent contractors , directly or indirectly 
paid by the contractor j eKcept for the project director and his secretary. 

Teachers used in the reading and mathematics programs will be employed 
by the contractor unless the district deems it necessary to employ these 
taachers as regular district personnel* Upon notification by the dis^ 
trlct to the contractor, the teachers used in the reading and mathematics 
programs will be employes of and paid by the district,,,. 

4, Specification of funds ^ including the amount and source of funding. 
In this project the district will provide funds for the following ^ 

physical plant facilities; maintenance and custodial services in project 
schools. All other costs will be funded under ESEA, Title I* 

5 , The schedule of fee payment : 




This provision could become very complex^ covering such issues asi the 
extent of guarantee; the natur© of the reimbursement, e,g,s mean gain versus 
individual gain; cost-plus or performance units only; reflection of incentives 
and penalties; and adjustment schedules. 

The performance incentive measurement for establishing the unit price to 
be paid by the district for each student in the reading and mathematics 
programs shall be based on the results of pretest and posttest gains as 
measured by the standardized tests and interim perf orttiRnce tests estab- 
lished for each program. The average fixed maKimum price based on gains 
in achievement level and interim perf ormance tests shall not exceed an 
average of $189,75 per student in the reading and mathematics programs, 

he total maximum incentive price for this contract for 550 students 
in each year of the reading and mathematics programs shall not exceed 
$220,438,50. 

Notwithstanding any other provisions of this contract , the contractor 
shall receive interim provisional cash payments equivalent to sixty 
percent (60%) of the estimatad total maximum contract price of $2203438,50, 
Provisional payTnents shall be separated into five (5) installment pay^ 
ments payable within ten (10) days following the administration of each 
interim test. Each payment will be the product of $26. '0 times the total 
number of students taking the Interim tests in mathematics and reading. 

Within fifty (50) days after the final posttest results are established 
and reported to the contractor by the auditing contractor ^ the contractor 
shall submit an adjusted final voucher stipulating the final unit price 




60 



ERIC 



for each student in the reading and mathematics programs with detailed 
supporting information. The voucher shall state the total amounts which 
may be refundable to the district or additionally payable to the con^ 
tractor in each program* 

6» A dtscrip tlon of the instructional program , without necessarily divulging 
proprietory concerns of either the district or the contractor i 

The terminal performance objective is to increase, by the specific amount 
the academic achievement and skill of fifth-grade pupils in reading and 
mathematics. To meet this objective, the teaching material will predom- 
inantly use the inquiry approach,..* 

7 * tondition for termination s 

The contract sTiould define the means for concluding the contract. 

All obligations of the district undertaken hereunder are wholly subject 
to federal funds being made available to the district and committed for 
the purpose of this contract, and the actual receipt of such funds by 
the district. In the event the funding from federal sources is not 
received by the district as anticipated during the contract performance 
period 5 this contract shall be terminated Immediately upon written 
notice by the district to the contractor. The district shall have no 
further liability for costs accrued or fees earned by the contractor 
after the giving of such notice...* 

8* Provisions for the conjtractor 's reporting and record keeping ; 

This clause should specify the format of reports ^ topics to be covered, 
frequency, and the person responsible for preparing and certifying the reports. 

The contractor shall maintain records to reflect all aetual start"=up and 
operating costs in accordance with reasonable reporting forms and procedur 
established by the management support groups and at specific intervals 
required by the project director for the reporting system and for such 
purposes of the overall project as are stated in this agreement. 

The contractor agrees to provide a full-time , on=site program manager 
\who, in addition to operations for the contractor^ will also be respon^ 
sible to obtain such data information.,,. 

The contractor agrees to maintain books^ records, documents and other 
evidence pertaining to the costs and expenses of this contract to the 
extent and in such detail as will properly reflect costs of labors ma-- 
terials, equipment^ supplies and services, and other costs and expenses 
of whatever nature for which reimburaement is claimed,,,, 

9* Provisio n s for the settlement of grievances and disput es and the agency 
t^ich will handle appeals s ^ ~ ~' ~^ ~^ ~^ 

This example provides for settlement of disputes within the district. 
Other alternatives, however, might include outside agencies,.,,. 

Except as otherwise provided in this contract, any dispute concerning 
a question of fact arising under this contract which is not disposed of 
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by agreement shall be decided by the project director ^ who shall reduce 
his decision to writing and furnish a copy thereof to the contractor. 
The decision of the project director shall be final and conclusive unless^ 
within thirty (30) days from the receipt of such copyj the contractor 
furnishes to the project director a written appeal addressed to the dis- 
trict general superintendent * The decision of the superincendent or 
his duly authorized representative for the determination of such 
appeal shall be final and conclusive unless determined by a court of 
conipetent jurisdiction to have been fraudulent, or capricious or arbi- 
trary, or so grossly erroneous as necessarily to imply bad faith, or 
not supported by substantial evidence* 

10 * Llq_uida ted dama ge^ and delays and de faults ^ 

This clause should cover the contingencies of both excusable delays and 
defaults and preventable delays and defaults* 

The contractor shall not be in default by reason of any failure in per-- 
formanca of this contract in accordance with its terms if such failure 
arises out of causes beyond the control and without the fault or, negli- 
gence of the contractor, . , > 

11 * Definition of the target populatlon i 

This should be a detailed clause including how the students are selected ^ 
what data are used, what type of students are Included , and conditions for 
the student's retention**,. These may be specified in an appendix or attested 
by the independent auditor as valid. 

All students in the reading and mathematics programs will have grade 
level deficiencies in reading and mathematics as determined by a stan- 
daTdized, coinmercially available , achievement test to be selected and 
administered by the district or its designee. Students will be selected 
for participation by the district through random assigninent from a tar- 
get population pool of IgSOO students in grade 5, The district shall 
obtain written parental consent for students to participate in the 
project. No students shall be placed in the reading or mathematics 
programs who would not be eligible and accepted for instruction in 
regular district classes by virtue of mental or emotional deficiencies » 
If, during the first thirty (30) days of the program^ the contractor 
determines that a student is not qualified to participate in the pro- 
gram because of emotional or mental deficiencies, it may request the 
student's removal in writing to the project director* Upon the proj^ 
ect director's determination ^ an individual test will be administered 
by a certified psychologist under the aegis of the auditing contractor* 
In all cases, the project director's decision on student participation 
shall then be final and binding* 

For the purpose of this contract^ the following are the only bona fide 
reasons for a student leaving the programi 

a. The student is retained in institutional care, such as in a hospitals 
or confined before or after trial for law violation . 

b. The family moves out of the metropolitan area. 

The student dies or is incapacitatad by illness or otherwise for 
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either a concinuous poriod of eleven (11) days or for intermittent 

periodB totaling nwenty (20) days in any three-month period, 
d. The acudent is removed upon request of parent or guardian. 

In all these cases, the contractor shall give written notice to the prol- 
ecc director when in its opinion a student's absences warrant removal " 
from the program. The project director shall obtain a written statement 
from the parent, and the validity of the stated cause shall be certified 
by the auditing contractor. 

The contractor shall daily furnish the names of any absent students to 
the project director, and the district shall use the same efforts and 
proceciures as are used for all other students in the school district to 
.ensure continued attendance at future sessions and at any make-up sessions 
which may be required. If the student transfers to another school in ^ 
the district, the district shall not be responsible for replacing such 
students m accordance with pru..edures determined by the project director 
If regular school schedules are changed, the district wil] ensure that 
time will be provided for students in the reading and mathematics proRram.? 
to continue to participate in these programa. 

A student shall not remain in the contractor's classes if receiving dis- 
ciplinary punishment, Including temporary expulsion from regular classes 
Ihe district shall inform the project director whenever a student receives 
disciplinary punishment or temporary expulsion necessitating removal 
from the contractor's classes. The contractor may request the district 
to initiate such action for particular Btudents based on their behavior 
in the reading and mathematics programs. 

Those students rernLning in the reading and mathematics programs after 
the first thirty (^u)-day period shall remain in such programs for the 
full nuinber of class days normally scheduled by the school for all stu- 
dents. Any student who does not remain in a program shall be the subject 
of inquiry and certification by the auditing contractor, and the reason 
for students leaving the programs shall be stated by the auditing con- 
tractor in an evaluation report..,. 

12. Provision for turnkey; 

The contractor agrees that, upon request of the project director, the 
contractor will expend a reasonable amount of effort in training local 
personnel in the maintenance and servicing of the contractor's proprietory 
equipment used in the reading and mathematics programs. 

The contractor agrees to train or orient project management staff selected 
by the project director and the management support group in the use of 
management techniques and approaches Involved in the contractor's in- 
structional systems. 

The contractor agrees to submit in writing to the managemerit support 
group and the project director, for their use In monitoring the overall 
project, a management plan with specific task assignments, activities, 
and planning uharts not later than thirty (30) days after the beginning 
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of instructiori. the contractor agrees to make available to the district 
on a confidential basis all internal planning and operational documents 
related to the conduct of the reading and niatheniatics programs, as may 
be deemed necessary by the district to fulfill the intent and purpose of 
the oV'^rall project, 

13* Schedule of penalties for non-compliance , for example, penalties for 
teaching the test by either contractor or district personnel. 

Within thirty (30) days of the commencement of the project ^ the auditing 
contractor wili. examine the programs that constitute the contractor -s 
curricula in reading and mathematics. If the auditing contractor finds 
within the materials test questions from the standardized examination 
being used to evaluate the Gontractorj it will identify these items in 
a written report to the contractor; in like manner, the contractor will 
present additional materials that it introduces for use in the project 
to the auditing contractor at least ten (10) days prior to their utili- 
zation in the project and the auditing contractor will identify items 
that are unacceptable , for the reason that such are contained in the 
standardised test being used for evaluation of the ..ontractor^ and report 
to the contractor within ten (10) days. 

If 3 upon presentation of the instances of "teaching the tests" the con-* 
tractor agrees with the auditing contractor, then the Items in question 
will be deleted from the curriculum. If the contractor disagrees with 
the auditing contractors the contractor will be permitted to preseiit 
Its case directly to the district. Should the district agree that the 
materials or items in question should not be used, the contractor will 
iTranediately remove them from its materials. If the contractor fails 
to do so promptly s the district may consider the contractor's inaction 
as a breach of this agreement. 

Other provisions which may be necessary in contracts are ^ The term of the 
contract 5 a statement of local philosophy ^ a statement of the evaluation 
design and/or specification of test instruments ; a statement of district 
monitoring policies; conditions for all testing; provisions for research 
and dev^elopinent being carried on in the schoolj definition of proprietary 
concerns; provision for changes in program; and a covenant against contingent 
fees. 
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Special Reports by the Editors of Edueation UJ.A. 



Siudvnfs liiiiht^ ttnd Hvspomibilitics : Cniirts 
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l-araprojvhsioimh hi Scluiok: II ow Now 
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ihrrn. I0y2. 61 pp,. #4IM2Hn4. Single 
cojiy, S I 

Yrar Round Srhofd: iJistrirh Dvvi^hp Siw 
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advantages and drmulvanlngc^, t'ornpanu 
live eosl figures, and eapsule review of 
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prngrani, phis eoniprehens^ive'cape muh 
iOB of year-miind programs, 197] fi | 
pp.. #41 M2ri()2, Single eopy. SI, 

Sharrd Srrvicrs and Coofjomtivrs! Srlionh 
Comhina Romurcm To Impnna Edih 
aifioth TfAh how ihe rural school diB- 
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f^n Hhare Buch serviees as ^peeinl educa- 
lion. einiehmenl progranis for niinority 
groups, roiniFeling and guidanre IOTT 
fin pp. #4I].|270aSlnglocopy. 84 

Drug Crish: Schooh Fight Back with bu 
rmiftitivv Progranhs. Puts the problem in 
perspeeilve, gives gpectfics of what is 
essenlial for a sueeeggful gdiool drng 
abuse program and degeribes ihe pro. 
grams ron-^idered mosl siicreRsful 107] 
61- pp.. #dlM2796. Shigle copy, 84. 
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die hmnb ihreat^^ delai!^ the role?^ uf 
j^eeurity perHonned anil how to invuKe 
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Individiudizdtion in Srhooh: The Cfiah 
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S4. 

Riwironmoni and the Srhooh, DemTibeH 
the best progranm uncler wav in stales, 
loeal j^tdiool distriei^. eollegti^ and nni^ 
veri^ilieh, Give^ die? pbiloKOjihy aiid oh^ 
jeeiive?^ of a good environnienta] eduen- 
don program. 19,1.56 pp.. #41142782. 
Single ropy, 81, 

I oratiimal Educatiim: hiuovations Rvvulu^ , 
tioui-v Curvvr Training. Describes the 
niOHl sueen^sful eareer training programs 
in elemenlary and seeondary sebooU, 
unicpje denelopnienU and Innavalivc- 
prografu??. aniounl and inlunded purpose 
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crbi(!alion progranm, 1Q7J. 61 pp.. #411- 
12780, Single eopy, 81. 

Prmdiool Bmikthrousih: What Works in 
Early Child/mad Education, Include^; a 
review of new philosophies and old eon^ 
ln*versles; sonie research resulls; a 
guide lo the fedeial ajiparalusi delailed 
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Haidiuff Crisis: Tha Problem and Sup- 
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signifiranl reeenl discovc^rles on reading 
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Diffmntiated Staffini^ in Srhooh. Examines 
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Irovergial method of slafT ui^anixation 
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84. 

Black Studies in Schooh, Shows that nearly 
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#41142746. Single copy, 84. 
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